-- Logs begin at Mon 2022-05-23 14:39:09 UTC, end at Mon 2022-05-23 15:56:31 UTC. -- May 23 15:12:57.248436 dv-cinder-840678-12-smb systemd[1]: Starting Devstack devstack@keystone.service... May 23 15:12:57.256269 dv-cinder-840678-12-smb devstack@keystone.service[80357]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:12:57 2022] *** May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: nodename: dv-cinder-840678-12-smb May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: machine: x86_64 May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: clock source: unix May 23 15:12:57.258270 dv-cinder-840678-12-smb devstack@keystone.service[80357]: pcre jit disabled May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: detected number of CPU cores: 4 May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: current working directory: / May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: detected binary path: /usr/bin/uwsgi-core May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: your processes number limit is 47680 May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: your memory page size is 4096 bytes May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: detected max file descriptor number: 2048 May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: lock engine: pthread robust mutexes May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: thunder lock: enabled May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 23 15:12:57.258723 dv-cinder-840678-12-smb devstack@keystone.service[80357]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:12:57.305046 dv-cinder-840678-12-smb devstack@keystone.service[80357]: Python main interpreter initialized at 0x555b0b9a59c0 May 23 15:12:57.305046 dv-cinder-840678-12-smb devstack@keystone.service[80357]: python threads support enabled May 23 15:12:57.305046 dv-cinder-840678-12-smb devstack@keystone.service[80357]: your server socket listen backlog is limited to 100 connections May 23 15:12:57.305046 dv-cinder-840678-12-smb devstack@keystone.service[80357]: your mercy for graceful operations on workers is 90 seconds May 23 15:12:57.305423 dv-cinder-840678-12-smb devstack@keystone.service[80357]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:12:57.305500 dv-cinder-840678-12-smb devstack@keystone.service[80357]: *** Operational MODE: preforking *** May 23 15:12:57.305767 dv-cinder-840678-12-smb devstack@keystone.service[80357]: *** uWSGI is running in multiple interpreter mode *** May 23 15:12:57.305767 dv-cinder-840678-12-smb devstack@keystone.service[80357]: spawned uWSGI master process (pid: 80357) May 23 15:12:57.305969 dv-cinder-840678-12-smb systemd[1]: Started Devstack devstack@keystone.service. May 23 15:12:57.308274 dv-cinder-840678-12-smb devstack@keystone.service[80357]: spawned uWSGI worker 1 (pid: 80364, cores: 1) May 23 15:12:57.308274 dv-cinder-840678-12-smb devstack@keystone.service[80357]: spawned uWSGI worker 2 (pid: 80365, cores: 1) May 23 15:12:57.308274 dv-cinder-840678-12-smb devstack@keystone.service[80357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:13:03.220225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:13:03.220225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes May 23 15:13:03.220982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:13:03.220982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: from cryptography.utils import int_from_bytes May 23 15:13:03.221094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:13:03.221094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: from cryptography.utils import int_from_bytes May 23 15:13:03.221094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:13:03.221094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: from cryptography.utils import int_from_bytes May 23 15:13:03.270241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:13:03.270439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:13:03.270526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:13:03.270623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] command line args: [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:13:03.270716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:13:03.270891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] command line args: [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:13:03.270987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:13:03.271067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ================================================================================ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:13:03.271170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:13:03.271302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.271405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ================================================================================ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:13:03.271572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_dir = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.271654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] admin_token = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.271763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.271848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] config_dir = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.271947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] config_source = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] debug = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] config_source = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] debug = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.272915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_config_append = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_config_append = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.273936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_dir = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_dir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.274969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.275943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.276888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.277871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] publish_errors = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] publish_errors = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.278914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.279937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] standard_threads = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] standard_threads = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] use_journal = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.280934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_journal = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.281013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] use_json = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.281085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_json = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.281757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] use_stderr = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.281894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_stderr = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.282084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] use_syslog = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.282219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] use_syslog = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.282350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.282476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:13:03.282476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.282981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.283904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.284882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.285992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.286954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.287948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.288949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.289884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.290976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.291991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.292913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.293981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.294873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.295991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.296891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.297567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.297705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.297705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.297912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.298976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.299986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.300875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.301940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.302914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.303909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.304974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.305974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.306443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.306567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.306683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.306798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.306913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.external = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.307892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.external = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.password = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] auth.token = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.308997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.password = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.token = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.309935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.310889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.311985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.312935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.313990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.314920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.315960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.316896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.317966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.318914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.319987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.320933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.321936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.322999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.323976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.324924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.325965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326310 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.326901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.327985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.328662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.328809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.328931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.329985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.330922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.331932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.332973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.333958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.334891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.335968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.336899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.337955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.338890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.339904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.340928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.341973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] role.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] role.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.342978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.343725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.344376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.344495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.344612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.344727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.344876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.345929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.346964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.347927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.348975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.349997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.350934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.351888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.352938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.353995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.354928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.355931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.356900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.357965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.358899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.359956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.360070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:13:03.360193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.360193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.360193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.360193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:13:03.360193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:13:03.388058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.388287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.388371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.388514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.388598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.388743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.397842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.398283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.426918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.427146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.427610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.427843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.481014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.481240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.532886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.533117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.533759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.533995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.600951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.601084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.601166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.601300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.601382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.601511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.625610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.625848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.626936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.627078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.627159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.627296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.627536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.627750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.639078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.641428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.651668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.651901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.652127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.652353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.652574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.652789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.653001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.657607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.657945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.658269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.658599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.658919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.659238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.659585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80365) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 23 15:13:03.672814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.673129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:13:03.673468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.673669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:13:03.673938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.674196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.674451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.674703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.676244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.676549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:13:03.677029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.677321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 23 15:13:03.677710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.678084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.678456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.678825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.685706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.685979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.686242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.686519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.695144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.695444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.695532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.695718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.696001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.698751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.699024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.699299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.699598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.699877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.700136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.700401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.700776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.701043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.701311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.701576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.707872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.711955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.712359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.712757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.713155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.713563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.713935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.714317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.714850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.715246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.715679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.716079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.729179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.730886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.731208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.737342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.737619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.737901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.744660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.745172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.745447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.746328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.746719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.749897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.750544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.751020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.751535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.752336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.752877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.760022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.760302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.764842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.765129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.765411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.765890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.766169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.766626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.766913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.767195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.771918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.772192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.776869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.780529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.780824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.786570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.786805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.786890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.790404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.791570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.794182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.794476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.794773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.795065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.795205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.795340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.795523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.795640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.801258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.804880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.808569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.808865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.809265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.809559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.809839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.810139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.815963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.816248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.816510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.816771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.824761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.826458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.826730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.829223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.829507 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.829774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.830037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.830120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.830376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.830655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.830934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.831209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.838325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.840055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.840334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.843415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.844226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.844665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.844978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.845259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.845729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.846008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.846287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.846582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.846863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.847135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.847441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.858946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.859236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.859589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.859883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.860165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.860439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.860719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.865627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.868890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.872178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.873781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.876226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.876523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.876804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.879159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.882552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.884152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.885766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.885900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.887543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.889298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.889848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.897321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.898919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.899379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.899667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.900042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.902342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.902630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.902912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.903192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.908721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.908999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.909272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.909541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.909804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.910070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.910351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.910622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.910893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.911157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.911450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.911709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.911974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.912238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.912855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.913145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.913423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.921436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80365) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 23 15:13:03.921718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.922645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.922928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.923199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.923499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.923789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.924073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.924349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.924617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.924887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.925154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.925427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.925700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80365) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 23 15:13:03.951938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b0b9a59c0 pid: 80364 (default app) May 23 15:13:03.955510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3c67-d89e-41fb-b358-63a2589dde8d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:03.955803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3c67-d89e-41fb-b358-63a2589dde8d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:03.956086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d3c67-d89e-41fb-b358-63a2589dde8d None None] PATH_INFO: `/v3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:03.960933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Mon May 23 15:13:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:03.965280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555b0b9a59c0 pid: 80365 (default app) May 23 15:13:11.870815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:11.871332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:11.871468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:11.872757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:11.881032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:11.881459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:11.881583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:11.949228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: INFO dbcounter [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] Registered counter for database keystone May 23 15:13:11.971035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG oslo_db.sqlalchemy.engines [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:13:11.977220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writer thread running {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:13:12.157937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80365) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:13:12.158384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG passlib.handlers.bcrypt [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80365) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:13:12.213872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:12.215504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:12.340606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1/3] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 23 15:13:12.506527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:12.581072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: INFO dbcounter [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] Registered counter for database keystone May 23 15:13:12.601237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG oslo_db.sqlalchemy.engines [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:13:12.607497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writer thread running {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:13:12.729172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b360aa-ed07-4dee-a6db-27cbb5bc209b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:12.733517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:12.734194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:12.734484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:12.734767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:12.742977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:12.795352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:13:12.795673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a3e90-9918-406e-be76-cefe269cbf50 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:12.805393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1324 bytes} [Mon May 23 15:13:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:13:12.811460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:12.826744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a16919-41a8-4fa4-a709-e81227dd47e7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:12.832377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:12.833792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:12.834078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:12.834359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] PATH_INFO: `/v3/projects/a4ecdc8eee23475faa49db60f90175a3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:12.836114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] RBAC: Authorizing `identity:get_project(project_id=a4ecdc8eee23475faa49db60f90175a3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:12.998207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 23 15:13:12.998862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd937d-005f-49bf-ae27-fff6b3672898 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:13.003653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 2/5] 10.222.0.46 () {56 vars in 1207 bytes} [Mon May 23 15:13:12 2022] GET /identity/v3/projects/a4ecdc8eee23475faa49db60f90175a3 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:15.162801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643068e-0697-41bd-bbca-d1b5cebf6d37 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:15.163290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643068e-0697-41bd-bbca-d1b5cebf6d37 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:15.163290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643068e-0697-41bd-bbca-d1b5cebf6d37 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:15.167634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 4/6] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:15.173708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:15.174237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:15.174237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:15.194119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:15.195695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:15.204027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 3/7] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 23 15:13:15.227327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643068e-0697-41bd-bbca-d1b5cebf6d37 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:15.239865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643068e-0697-41bd-bbca-d1b5cebf6d37 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:15.244107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:15.244751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:15.245039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:15.245320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:15.253569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:15.255347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4ccf7-a6e1-443f-9425-891df78ccc97 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:15.264112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 5/8] 10.222.0.46 () {58 vars in 1324 bytes} [Mon May 23 15:13:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:13:15.270267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:15.279485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c3e61-5792-4c5a-8ec7-a133b00e9c51 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:15.284058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:15.284917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:15.285206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:15.285485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:15.286887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:15.288784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681983b-4315-437c-aa5b-ac53bd71d0cb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:15.290360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 4/9] 10.222.0.46 () {56 vars in 1198 bytes} [Mon May 23 15:13:15 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:17.552936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668ae3-2396-4d9d-a09d-f27bf31cc9be None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:17.553455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668ae3-2396-4d9d-a09d-f27bf31cc9be None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:17.553561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668ae3-2396-4d9d-a09d-f27bf31cc9be None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:17.554831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:17.560230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:17.560635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:17.560797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:17.570292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050d7-5260-4a8d-a801-56bc3b792e67 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:17.570580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050d7-5260-4a8d-a801-56bc3b792e67 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:17.570857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050d7-5260-4a8d-a801-56bc3b792e67 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:17.572187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 7/11] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:17.577280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:17.577568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:17.577850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:17.578332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:17.579695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:17.617971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG passlib.handlers.bcrypt [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80364) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 23 15:13:17.618382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG passlib.handlers.bcrypt [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80364) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 23 15:13:17.659164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 5/12] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:17.666250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:17.667892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:17.682452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:17.706951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:17.773061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 8/13] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:17.787381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb0cb-c012-41bf-b768-066633514b97 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:17.794452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:17.827550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:17.828410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:17.828699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:17.828979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:17.842247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:17.853995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:17.855083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:17.855941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 6/14] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:17.862162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:17.948103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:17.967163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227847-125a-48ae-b0d3-b9e3e875b1d6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.001585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.002380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.002668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.002943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.003737 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:18.004047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.005451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.005626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df15bb6-9745-49aa-b9cb-77c8e7b98c09 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.007866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:18.017531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 7/15] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:18.022983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:18.047055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.048104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.048906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.049191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.116006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.117453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.123332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f074-acd9-49cc-824c-f65cb58922a3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.157578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.158417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.158708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.158983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.160229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.161689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.163333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 8/16] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:18 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:18.168660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:18.182733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:18.219351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:13:18.225528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:18.228211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:18.270329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9860b9-0006-4d07-96ee-aa6f4100cee2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.304552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.305341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.305623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.305897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.307257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.308742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.310342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:18.316774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:18.327921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb5dd-66b4-4029-bbb5-2b9fd0669509 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.364857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.365642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.365926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.366250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.384906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.386369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.398219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:13:18.407542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:18.408376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:18.409288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:13:18.409288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:13:18.409288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:13:18.409288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:18.409288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:18.414748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:18.418808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778fe0f-6347-454e-bb37-003dd468c5f4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.453826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.454541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.454827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.455225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.456109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.domain.id=default, user.id=b624fe749c804741bda23ecac0c46159) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:18.456427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.457912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4d13-674c-4908-80f7-fa0e65c1ce98 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.464881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1322 bytes} [Mon May 23 15:13:18 2022] GET /identity/v3/role_assignments?user.id=b624fe749c804741bda23ecac0c46159&scope.domain.id=default&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:18.471790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:18.521180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223c54-dfd2-4a45-b521-1c9810a83fb2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:18.557826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:18.558520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:18.558775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:18.559050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:18.559830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:18.560142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:18.561581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923eded-a541-4ea0-959d-44d247fb6ccf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:18.581881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:21.029324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2b43-edb6-4bc9-923d-c9ba3dd6089d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.029856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2b43-edb6-4bc9-923d-c9ba3dd6089d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.029856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f2b43-edb6-4bc9-923d-c9ba3dd6089d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.031258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:21.037454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.038298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.038779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.069514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:21.071041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:21.165996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:21.205546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-f46f-426a-8593-bf590d3f4154 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.206193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-f46f-426a-8593-bf590d3f4154 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.206682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029af46-f46f-426a-8593-bf590d3f4154 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.208344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:21.209857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:21.214638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12c4-55cb-4185-813b-dc4306288fb5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.215213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12c4-55cb-4185-813b-dc4306288fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.215743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead12c4-55cb-4185-813b-dc4306288fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.256404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ead12c4-55cb-4185-813b-dc4306288fb5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:21.257959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ead12c4-55cb-4185-813b-dc4306288fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:21.297442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:21.369380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708688c3-db83-40ca-957d-f7f3c218411c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:21.426146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:21.448999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:21.449817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.450168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.450384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.462676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110fac-09b0-4a93-9917-59b0b2cc123b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.463190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110fac-09b0-4a93-9917-59b0b2cc123b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.463638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f110fac-09b0-4a93-9917-59b0b2cc123b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.465149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:21.467291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f110fac-09b0-4a93-9917-59b0b2cc123b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:21.476329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-50004ce2-cb7d-42f0-a4b9-1255a1b0d89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:21.489541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:21.490596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:21.491587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 13/27] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:21.492522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.492812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.493093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.530981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:21.535112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:21.576505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:21.618308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f110fac-09b0-4a93-9917-59b0b2cc123b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:21.677099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 14/28] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:21.679031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:21.696336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:21.697074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.697363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.697646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.698908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:21.700357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:21.763786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:21.864189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ef381-e3df-4515-badb-5bfaa91fccf5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:21.864370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 15/29] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 15:13:21 2022] POST /identity/v3/roles => generated 219 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:21.865323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:21.908680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:21.909379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.909667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.909951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.910843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:21.911165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:21.912717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6d05-e4ef-4796-8dc3-950f2eed8d94 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:21.927500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 15/30] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:21.929702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431eb3b-0e65-4ae1-bc0f-e2f95bbde84f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.929702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431eb3b-0e65-4ae1-bc0f-e2f95bbde84f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.929702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431eb3b-0e65-4ae1-bc0f-e2f95bbde84f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.930694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 16/31] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:21.943721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:21.944446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:21.944940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:21.964057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:21.965571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:22.049198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 17/32] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:22.051135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.119757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.120660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbe7bc-f1c4-49a7-80cf-de5dbf86c628 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.168274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.169451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.169953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.170594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.173880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.187082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.189040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:13:22.213321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:22.214200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 16/33] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:22.215501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.243824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c27b6c-0e79-4d2d-bb53-4491a0234592 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.285721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.286950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.287472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.288045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.289943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.291801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.298252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 18/34] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:22 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:22.298252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.367459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6ab6-c133-44df-b4d9-32f43d28ff5f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.413097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.414540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.415264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.415747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.416931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.419242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.421301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.429838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ef201-dd17-4aeb-b537-cf9f5f5433e2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.440712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 17/35] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 15:13:22 2022] POST /identity/v3/roles => generated 225 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:22.442355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.481496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.485290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.485615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.485962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.489074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:22.490655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.494439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48eec3c-d5ce-4561-b47b-ed9b4b203146 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.519706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 19/36] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:22.522239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2f3d-fc83-46b6-9176-9c2cab8d08a9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.522538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2f3d-fc83-46b6-9176-9c2cab8d08a9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.522820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a2f3d-fc83-46b6-9176-9c2cab8d08a9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.525641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 20/37] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:22.526312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2f3d-fc83-46b6-9176-9c2cab8d08a9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.533647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.603445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f38-a120-47fb-8642-9548bb9ae633 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.644438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.645281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.645574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.645895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.647138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.649081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf36c9-520b-4b1b-b4ad-85bc0bdb77af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.650761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 18/38] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:22.652239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.652536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.653241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.669784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a2f3d-fc83-46b6-9176-9c2cab8d08a9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.673152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:22.675233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:22.713526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.717212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.717212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.717212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.717212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.717212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.766137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 19/39] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:22.767439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.830904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.859192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:13:22 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:22.860082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:22.881362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:22.901806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad81345-1434-42b0-a7e9-82a3e425e7a1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:22.946522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250666bd-390e-4de0-874f-957c199c01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:22.948647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250666bd-390e-4de0-874f-957c199c01de None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:22.949443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250666bd-390e-4de0-874f-957c199c01de None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:22.949956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250666bd-390e-4de0-874f-957c199c01de None admin] PATH_INFO: `/v3/domains/default/users/b624fe749c804741bda23ecac0c46159/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:22.953549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250666bd-390e-4de0-874f-957c199c01de None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b624fe749c804741bda23ecac0c46159, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:22.956381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250666bd-390e-4de0-874f-957c199c01de None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:22.977279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1361 bytes} [Mon May 23 15:13:22 2022] PUT /identity/v3/domains/default/users/b624fe749c804741bda23ecac0c46159/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:23.009617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8ff0-57d3-48c1-9858-3f2fc004ceee None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:23.009965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8ff0-57d3-48c1-9858-3f2fc004ceee None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:23.010191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8ff0-57d3-48c1-9858-3f2fc004ceee None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:23.011980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 21/42] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:23.013419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178f517-6f7d-422c-8412-ed58fd60ffcd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:23.020295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:23.020642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:23.020867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:23.039931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:23.041301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:23.057337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:23.058810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:23.059325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:23.059828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:23.060800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:23.062621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:23.082980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 22/43] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 15:13:22 2022] POST /identity/v3/roles => generated 223 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:23.134158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 22/44] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:23.158146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:23.244798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:23.286104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac9fa-94a4-4a0b-90b0-219adef47a87 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:23.321448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:23.322252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:23.322537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:23.322815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:23.324164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:23.325634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89d719-b897-4f1a-984b-734fecb42745 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:23.327400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 23/45] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:23.334145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:23.367527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:23.435587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddfeb0-b0ab-4ba9-8f9f-38ee515f59cd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:23.470456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:23.471126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:23.471438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:23.471721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:23.472443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:23.473921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a475ef2-ed67-4bdb-a07e-a97909204bdf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:23.500276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:13:23 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:13:25.204339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715f46-06f4-4098-b182-8e7619e547c7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.205327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715f46-06f4-4098-b182-8e7619e547c7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.205327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5715f46-06f4-4098-b182-8e7619e547c7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.206760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 24/47] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:25.212472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.212874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.213042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.230672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:25.231917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:25.298752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:25.321527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5715f46-06f4-4098-b182-8e7619e547c7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.422408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5715f46-06f4-4098-b182-8e7619e547c7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:25.456138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:25.456862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.457151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.457433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.460338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:25.468527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:25.476684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:25.477504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:25.478270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 25/49] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:25.483761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.501560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:25.595251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324de5c-062a-4d2d-82ce-02ac4bc399a8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:25.630867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:25.631569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.631859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.632136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.632887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:25.633198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:25.634606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd95c6b-8350-4957-b2fe-d0367e80593d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:25.642793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 25/50] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:25.648963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.727914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06eea-5f3a-4e3f-8321-2f7e4851d93c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.728325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06eea-5f3a-4e3f-8321-2f7e4851d93c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.728618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06eea-5f3a-4e3f-8321-2f7e4851d93c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.730011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 26/51] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:25.735042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.735338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.735658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.752576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:25.753786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:25.770204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fe12-0854-4756-bb79-d089cd4ec7af None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:25.804899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:25.805790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.806169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.806364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.808776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:25.810262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:25.811975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 26/52] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:25.817598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.826261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:25.850601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.860567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:25.880396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:25.918640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d013e-7ae3-493d-a8d9-d0f355d9347f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:25.949303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2c6a6-a5d6-4ae0-9b11-cbb7b4687638 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:25.951146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:25.951964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.952254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.952533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.953725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:25.955829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:25.957623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 27/54] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:25.963456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:25.985288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:25.986020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:25.986438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:25.986722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:25.987922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:25.989403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:25.991189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:25.996396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:26.069705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac45ce-fb95-4b07-b919-ce693196c6fd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:26.084384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:26.100530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:26.105906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19911991-6c49-428c-859e-633094073458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:26.106600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911991-6c49-428c-859e-633094073458 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:26.106887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911991-6c49-428c-859e-633094073458 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:26.107168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911991-6c49-428c-859e-633094073458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:26.108035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19911991-6c49-428c-859e-633094073458 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.domain.id=default, user.id=b624fe749c804741bda23ecac0c46159) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:26.108347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19911991-6c49-428c-859e-633094073458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:26.108433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659702c-7bf1-4095-aff0-ff8c092843fc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:26.109789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19911991-6c49-428c-859e-633094073458 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:26.118996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1322 bytes} [Mon May 23 15:13:25 2022] GET /identity/v3/role_assignments?user.id=b624fe749c804741bda23ecac0c46159&scope.domain.id=default&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:26.143684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:26.144372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:26.144657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:26.144935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:26.145666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:26.147181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70866ec-5663-4aa6-adb6-5ee285cabad9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:26.174057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1140 bytes} [Mon May 23 15:13:25 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:13:28.449164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9072b9-299f-4dd1-a155-92d496b4ba40 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:28.449707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9072b9-299f-4dd1-a155-92d496b4ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:28.450074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9072b9-299f-4dd1-a155-92d496b4ba40 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:28.452451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:28.458379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:28.458793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:28.458945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:28.476169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:28.477362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:28.542494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:28.567848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9072b9-299f-4dd1-a155-92d496b4ba40 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:28.666162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9072b9-299f-4dd1-a155-92d496b4ba40 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:28.698810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:28.699663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:28.699900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:28.700179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:28.701340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:28.702765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286417c-a9d2-459c-8e4b-a1ce2983f73b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:28.704379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:28.710040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:28.768433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:28.810985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea17b7-3aaa-4bf2-b882-2ca1c706e5e3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:28.845663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:28.846920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:28.847208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:28.847515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:28.848222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:28.849679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f23bb8-3485-4e35-bdd7-7907c8a71ab0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:28.873695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:28 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:32.316491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd464-39ba-40c4-a393-2eaeb1e88b8d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.317008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd464-39ba-40c4-a393-2eaeb1e88b8d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.317082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bd464-39ba-40c4-a393-2eaeb1e88b8d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.318434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 31/62] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:32.323893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.324328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.324504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.349855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:32.351069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:32.383949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18b17-db84-44c9-b477-be076347c6dd None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.384273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18b17-db84-44c9-b477-be076347c6dd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.384522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18b17-db84-44c9-b477-be076347c6dd None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.385898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:32.391994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a601-526e-41f0-8faa-6b14829af8bc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.392285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a601-526e-41f0-8faa-6b14829af8bc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.392570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366a601-526e-41f0-8faa-6b14829af8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.417751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6366a601-526e-41f0-8faa-6b14829af8bc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:32.419288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6366a601-526e-41f0-8faa-6b14829af8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:32.467308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 32/64] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:32.492512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:32.524905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:32.536021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 33/65] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:32.537384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f2be-4047-4bc3-8dc3-31a8e9e80125 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.537679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f2be-4047-4bc3-8dc3-31a8e9e80125 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.537963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63f2be-4047-4bc3-8dc3-31a8e9e80125 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.539244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 34/66] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:32.564830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.565338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.565683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.583861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:32.585178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:32.586429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:32.600615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3491c4-9fa1-47a1-bbfa-291f5f59f018 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:32.637803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:32.638627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.638923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.639208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.651931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:32.660176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:32.661118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:32.661888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 33/67] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:32.662515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:32.665418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 35/68] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:32.672853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:32.772583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bcb25-ae69-4b03-b33e-f12d321c67d1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:32.775166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:32.807067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418c6f-9d15-43d9-80b6-0851bdee1fec None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:32.814096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:32.815633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.815934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.816210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.828807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:32.836900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:32.837740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:32.838511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:32.840161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:32.840624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:32.854769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:32.855476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.855764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.856045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.856800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:32.857106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:32.858504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff2330-f97a-4a43-9e79-8a23b080606a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:32.867530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:32.868731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b69e4-a2d0-433e-a257-838377ce15f5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.869020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b69e4-a2d0-433e-a257-838377ce15f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.869298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b69e4-a2d0-433e-a257-838377ce15f5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.870683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 37/71] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:32.871223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b69e4-a2d0-433e-a257-838377ce15f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:32.940997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe5ef-cf29-4dd0-a7da-80446aa94be5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:32.971879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b69e4-a2d0-433e-a257-838377ce15f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:32.976241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:32.977054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.977344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.977628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:32.988568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fbb4d81d-8e64-4499-991e-abd53de9f150 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:32.996532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:32.997537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:32.998523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 35/72] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:32.999307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ae9c-9f9e-48b1-9d35-0e5cff059a17 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:32.999307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ae9c-9f9e-48b1-9d35-0e5cff059a17 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:32.999556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877ae9c-9f9e-48b1-9d35-0e5cff059a17 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.000885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 36/73] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:33.001593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ae9c-9f9e-48b1-9d35-0e5cff059a17 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.018652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.019868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.020393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.020917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.022164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:33.022526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.024153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca358ddd-ac7c-40d9-9266-bd35a011151d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.029326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.034216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.035568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.035863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.036149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.053848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:33.055041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:33.098129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.110879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877ae9c-9f9e-48b1-9d35-0e5cff059a17 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.120621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 39/75] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:33.121648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.146049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.146927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.147215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.147529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.148729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.150212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e41c9f-4746-4a1b-ba95-3e9b3bb4ad88 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.151884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 37/76] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.153086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.153534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.153703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.170963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:33.172185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:33.229433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebefff2-4d6d-4e6e-88a9-243b108c25db None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.238239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 38/77] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:33.239081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.265127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.272583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.273260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.273544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.273820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.274568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:33.274873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.276275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.284330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 40/78] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.285198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.326466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.345513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb858fa4-02a1-4d4c-adcb-3eadeedfc311 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.381133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.382031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.382395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.382685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.385272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87d43a-b531-4f27-afe6-570e2d6faa14 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.396033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.397506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.399188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 39/79] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.399994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.418565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.419484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.419717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.420000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.430814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:33.438574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:33.439436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:33.441082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 41/80] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:33.442247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.486514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.507390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f5a7-6c35-43d8-9f4f-9da4effa3af6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.541656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.542504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.543433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.543715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.544081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.544713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4f16-73e6-42b7-b548-10324510d177 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.579529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.580326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.581170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.581449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.582681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.584170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.586056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 42/81] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.586829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.612892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.614384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.683884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682b5b2-3eea-42f8-b362-0766949b4b0f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.693590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.714793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 40/82] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:33.715646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.719086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.720003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.720298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.720573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.721826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.723284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.725115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 43/83] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.725720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.760622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.825558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfefef-0f04-42f2-aa60-c7361c064d7f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.826339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8bda5-0681-4b55-843c-2529efb6139b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:33.860462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.860651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:33.861118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.861233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:33.861406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.861521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:33.861685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.861822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:33.862744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:33.863054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.864460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.872480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 44/84] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:33.873247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:33.914912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.934387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:33.935888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:33.967991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:33.971912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb3a0a-fe06-4b42-9b51-74cc4ae2f74b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.006166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.006839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.007130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.007444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.008161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.009625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.035004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 45/85] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:33 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:34.035414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 41/86] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:34.035868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.036644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.132103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.155613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2866c5d-2142-4719-a5c2-0fb589be0002 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.157097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba6229-2eb8-4646-a479-ba184d0712df None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.194858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.195048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.195469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.195688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.195783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.195981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.196072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.196267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.197527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.199034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.205539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 46/87] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.205539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.233276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.277400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.278901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.343484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736bcf6-118b-4a06-b891-43aa8e12cfb2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.384995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.388627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.389679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.389973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.390558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.391866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.394612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.397403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 47/88] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.398514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.407055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 42/89] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:34.412411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.507805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.519262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57916017-c053-4b5f-b5fb-739d8c3636f0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.523158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea3564-4e31-463f-bbc1-2d8e0577e761 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.556834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.557938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.558400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.558821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.559776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.560374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.560552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.560902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.561255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.562220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=b624fe749c804741bda23ecac0c46159) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:34.562598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.562703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.564261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.565099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 48/90] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.566294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.572186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 43/91] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/role_assignments?user.id=b624fe749c804741bda23ecac0c46159&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.573257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.635816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.703957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699edf8-04da-44bb-865a-79a91ba44208 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.743681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.744615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.744865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.745224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.746442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.748011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.749839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 44/92] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.754930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76d0c-f630-4ba9-af98-43daed762e01 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.756286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.813996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.814829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.815216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.815838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.876382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.879796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b05c2-f3f9-40c4-9d83-9420a5712348 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:34.894995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:34.918879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909563-024d-49a8-9b76-65f883516781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:34.919591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909563-024d-49a8-9b76-65f883516781 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:34.919883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909563-024d-49a8-9b76-65f883516781 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:34.920165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909563-024d-49a8-9b76-65f883516781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:34.921015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909563-024d-49a8-9b76-65f883516781 None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:34.921329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909563-024d-49a8-9b76-65f883516781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.922810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909563-024d-49a8-9b76-65f883516781 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:34.930253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 45/93] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:34.931003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909563-024d-49a8-9b76-65f883516781 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:34.977858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:34.979388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:35.151864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909563-024d-49a8-9b76-65f883516781 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:35.192562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 49/94] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:35.198518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:35.244737 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:35.245429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:35.245725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:35.246005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:35.246871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:35.247193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:35.248713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:35.265688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 46/95] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:34 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:35.274555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:35.345682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d862-3ce7-4459-b41a-8cbe73503ff6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:35.398350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:35.399308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:35.399621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:35.399905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] PATH_INFO: `/v3/projects/7a9e901be8e547f6bd8615c35b89b81b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:35.401345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=7a9e901be8e547f6bd8615c35b89b81b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:35.402921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92472381-d945-429f-94a8-1c7410f25bd4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:35.410060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 50/96] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:35 2022] GET /identity/v3/projects/7a9e901be8e547f6bd8615c35b89b81b => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:35.416228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:35.489926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:35.561046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd3f01-ad1b-4e98-8460-6bba29fb95d9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:35.599895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:35.600568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:35.600859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:35.601144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:35.601993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=7a9e901be8e547f6bd8615c35b89b81b, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:35.602314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:35.603825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82473047-0256-40a2-9959-346ccfd7ccfc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:35.610074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 47/97] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:35 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=7a9e901be8e547f6bd8615c35b89b81b&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:36.743147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288aaa-4357-44e9-8a92-979a6b00f39c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:36.743788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288aaa-4357-44e9-8a92-979a6b00f39c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:36.743788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23288aaa-4357-44e9-8a92-979a6b00f39c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:36.745412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 51/98] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:36.751339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:36.752210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:36.753264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:36.771091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:36.772726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:36.855399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 48/99] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:36.879557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23288aaa-4357-44e9-8a92-979a6b00f39c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:37.013284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23288aaa-4357-44e9-8a92-979a6b00f39c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:37.049030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:37.059970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:37.061360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.061961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.062560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.079791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:37.088800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:37.089775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:37.090578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 52/100] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:37.095966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:37.152149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:37.241981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68a6d-0532-45ca-a850-1dad2ac2ac28 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:37.290633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:37.291239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.291611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.291896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.292665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:37.292982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:37.294404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:37.307516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 49/101] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:37.313278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:37.436454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891fc8-1121-443d-8905-c6cd4748d372 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:37.489298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:37.490204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.490495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.490779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] PATH_INFO: `/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.512147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] RBAC: Authorizing `identity:get_user(user_id=7dfb7c853a6c4dcfabfc39df6e857d82)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:37.513678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486aa3e-7da6-459e-ace5-2e30408dcd78 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:37.515840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 53/102] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:37 2022] GET /identity/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:37.521580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:37.657182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:37.665042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac16c8-5c2e-478e-9a26-a1060e7850ad None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:37.699296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd35f-82c7-4ecf-9c5f-4315114a3791 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.699627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd35f-82c7-4ecf-9c5f-4315114a3791 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.699909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcd35f-82c7-4ecf-9c5f-4315114a3791 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.701451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 54/103] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:37.708088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:37.708764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.709047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.709331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.709645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:37.710228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:37.710965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:37.733343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:37.735433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:37.819897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:37.827393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:37.828194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:37.880979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 55/104] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:37.908185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:37.997254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:38.011311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 50/105] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:38.016960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.109687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aab9f-05e2-4ce9-9213-d3378e6d6adf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:38.178503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785779e-3887-4338-91cc-92c23fab0faa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:38.180123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:38.180964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.181257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.181540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.183023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:38.184299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:38.185957 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 56/106] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:38.208780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.224317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:38.225592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.226079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.226613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.234906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:38.236665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:38.239017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 51/107] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:38 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:38.245018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.260901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:38.321883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:38.368924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9170c9a-e0c9-4ba2-9130-d7542940e9aa None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:38.373782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8355-2934-4c60-982d-5e0a444cc97a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:38.430816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:38.431441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.431737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.432025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.432769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:38.434275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b565ae-460a-4b9d-81b7-758bc782cd60 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:38.448675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:38.449376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.449665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.449945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.450817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=7dfb7c853a6c4dcfabfc39df6e857d82) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:38.451137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:38.452708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd9d8-0891-44b0-9e80-5477bca63f1b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:38.464902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 52/108] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:38 2022] GET /identity/v3/role_assignments?user.id=7dfb7c853a6c4dcfabfc39df6e857d82&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=ecf2040a2471456090a7677fc8bf172a => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:38.466310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de89c-64e4-4ebd-bc82-9924dae7d627 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.466612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de89c-64e4-4ebd-bc82-9924dae7d627 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.466897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de89c-64e4-4ebd-bc82-9924dae7d627 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.476673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 53/109] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:38.490402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.490736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.490981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.494810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 57/110] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:13:38 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:13:38.524596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:38.525848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:38.569939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad29a-3ac7-4af4-ad67-f42a4ad8e62b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.570245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad29a-3ac7-4af4-ad67-f42a4ad8e62b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.570580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad29a-3ac7-4af4-ad67-f42a4ad8e62b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.572446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 58/111] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:38.578506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b8da-edb9-404f-83ae-da2ad67ca935 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.578858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b8da-edb9-404f-83ae-da2ad67ca935 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.579204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b8da-edb9-404f-83ae-da2ad67ca935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.606779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ff03b8da-edb9-404f-83ae-da2ad67ca935 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:38.608121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ff03b8da-edb9-404f-83ae-da2ad67ca935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:38.662816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 54/112] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:38.698116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.733872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 59/113] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:38.735387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bef20-aad3-4d8d-9b30-7f373ef2d431 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.735683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bef20-aad3-4d8d-9b30-7f373ef2d431 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.735975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bef20-aad3-4d8d-9b30-7f373ef2d431 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.737613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 60/114] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:38.743299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.743614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.743896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.761833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:38.763051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:38.787844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:38.824411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:38.853984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 61/115] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:38.855039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.876205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ffa56-a83b-400c-9e65-6eaa68350368 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:38.915234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:38.916179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:38.916464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:38.916741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:38.928945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:38.937305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:38.938162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:38.938940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 55/116] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:38.939600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:38.976882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768801f-a032-41a7-884b-3909d2fde535 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.017337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.018317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.018848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.020068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.032178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:39.041814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:39.043933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 62/117] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:39.045865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.063644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.064591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee966a66-261f-42f5-8a40-3d6f24f22572 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.086973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.114833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.115681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.115973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.116260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.126864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:39.134815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:39.135898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 56/118] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:39.136915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.172798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee340f88-02d8-4ff9-8b66-07a8f9aec0bb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.214454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10594687-912d-41a4-bea5-5742561c454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.215289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594687-912d-41a4-bea5-5742561c454f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.215704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594687-912d-41a4-bea5-5742561c454f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.216212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10594687-912d-41a4-bea5-5742561c454f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.217081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10594687-912d-41a4-bea5-5742561c454f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:39.217466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10594687-912d-41a4-bea5-5742561c454f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.219056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10594687-912d-41a4-bea5-5742561c454f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.229319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 63/119] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.234891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324d968-efab-404c-9e0d-2a5cf512b903 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.235197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324d968-efab-404c-9e0d-2a5cf512b903 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.235523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324d968-efab-404c-9e0d-2a5cf512b903 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.236857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 64/120] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:39.237827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324d968-efab-404c-9e0d-2a5cf512b903 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.247581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfc96d-5b8c-4223-88ff-761f7b6145cd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.291999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.292695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.293289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.293583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.294644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:39.294965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.296935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.307380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 57/121] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.308582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.339814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.359952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324d968-efab-404c-9e0d-2a5cf512b903 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.367311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.403291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.405166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.405624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.406062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.406981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:39.407461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.409015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfd29b-5c5d-42d0-8542-2213aa26922c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.421649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 65/122] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.423154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.423625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.424554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.441403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cdd3f-ce6e-4e59-9997-da90a315b6a9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.445297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:39.446672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:39.479704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.480608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.480903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.481186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.482588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.484028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.485796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 58/123] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.486641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.523187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 66/124] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:39.524372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.596358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.602093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51acbdb-2c12-4017-ba0c-fe239ce48a5d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.612673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.634966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08006ce-0425-45ae-87f2-37f7c4913df1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.640357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.641312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.641748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.642038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.643330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.645690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.647544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 59/125] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.652526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.682623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.683802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.684098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.684387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.685788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.687884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.690129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 67/126] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.691486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.782510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecd27e-5d4d-43c2-bbca-018e0b01205c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.826394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.826907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c02fb-2db5-47f4-a71f-108bc8affcf5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.827327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.827661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.828158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.829387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:39.831005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:39.833249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 60/127] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:39.834047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.878984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.881183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.881635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.882078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.886650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.888588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:39.901347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:39.913024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:39.914102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:39.915170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:39.918385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 68/128] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:39.919332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:39.958401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974b04-c4ba-478e-bc47-313f279d14a3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:39.996428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:39.997517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:39.997929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:39.998311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:39.999667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.001286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.008189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 61/129] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:40.008189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.051841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c495f-4cde-46fa-b2e1-43102cccbab4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.097851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.099251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.099751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.100205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.101772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.104267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.107474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 69/130] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:39 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:40.108448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.151410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12041e-9682-4d29-b066-5caecfbc03dc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.166726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:40.180019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:40.198759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.200327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.200761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.201448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/b624fe749c804741bda23ecac0c46159/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.204368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, user_id=b624fe749c804741bda23ecac0c46159, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.206826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.227295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 62/131] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:40 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/b624fe749c804741bda23ecac0c46159/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:40.227906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.234888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de3839-0637-4639-af03-fc55bc85c97d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.285425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.286595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.287429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.287891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.288862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:40.289371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.291443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.304030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 70/132] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:40.305566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.352072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc17731-f479-4aa7-8c16-52bae020a650 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.408134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.409065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.409428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.409731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/e16507240f7444d284829a7f1b8c20db/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.417492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, user_id=e16507240f7444d284829a7f1b8c20db, role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.419026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.434614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b9297-0ffb-4b5b-b667-0ea8548a2fc3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.456383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 63/133] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:40 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/e16507240f7444d284829a7f1b8c20db/roles/e44bbee3e1df41568b635760aa1e44dd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:40.457030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.480131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:40.497128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.499655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.500996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.501485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/e16507240f7444d284829a7f1b8c20db/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.511315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, user_id=e16507240f7444d284829a7f1b8c20db, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.512886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.539928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:40.543127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 71/134] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:40 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/e16507240f7444d284829a7f1b8c20db/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:40.647468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595b84d-ffab-4474-99f7-2239e64ec5e6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.705648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.707124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.707443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.707721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.709099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.710684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.712823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 64/135] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:40 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:40.718665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.837147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd57cd-f9fe-4b45-b2a4-946b45939cfc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:40.874128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:40.875017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:40.875309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:40.875631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] PATH_INFO: `/v3/projects/7a9e901be8e547f6bd8615c35b89b81b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:40.876870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7a9e901be8e547f6bd8615c35b89b81b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:40.878409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7efee1-ae2a-48a6-9b2c-037f9c2413e3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:40.880522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 72/136] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:40 2022] GET /identity/v3/projects/7a9e901be8e547f6bd8615c35b89b81b => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:40.886158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:40.999907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:41.004348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe63a00-148b-451c-89a2-aa6952049315 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:41.052928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:41.053902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.054196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.054476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] PATH_INFO: `/v3/projects/7a9e901be8e547f6bd8615c35b89b81b/users/e16507240f7444d284829a7f1b8c20db/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.056571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] RBAC: Authorizing `identity:create_grant(project_id=7a9e901be8e547f6bd8615c35b89b81b, user_id=e16507240f7444d284829a7f1b8c20db, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:41.058054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6284c-940a-48d2-b28c-f7c0a3049efa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:41.076665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 65/137] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:40 2022] PUT /identity/v3/projects/7a9e901be8e547f6bd8615c35b89b81b/users/e16507240f7444d284829a7f1b8c20db/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:41.489555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3300-a4d5-47b4-90bf-fc5acdd014e3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.489916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3300-a4d5-47b4-90bf-fc5acdd014e3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.490115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3300-a4d5-47b4-90bf-fc5acdd014e3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.491582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 73/138] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:41.497278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.497580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.497871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.516358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:41.517557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:41.570595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877e4-73aa-4fa9-b4b4-085eed3f6229 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.570920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877e4-73aa-4fa9-b4b4-085eed3f6229 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.571270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb877e4-73aa-4fa9-b4b4-085eed3f6229 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.572866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 74/139] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:41.578011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.578308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.578653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.594585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 66/140] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:41.613309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:41.614526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:41.619617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:41.707038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:41.738369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 75/141] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:41.767310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:41.775251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:41.802438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf2c5b-8b02-485c-94d5-347852cb1a71 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:41.880360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:41.880764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe3b0-106e-43c3-9a17-8153c96c3ac7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:41.881194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.881446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.881726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.907957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:41.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:41.917452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:41.918657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 67/142] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:41.923131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:41.923810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:41.923991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:41.924268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:41.924557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:41.928086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:41.929579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:41.931245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 76/143] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:41.936505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:42.050806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:42.127871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dab0d-4918-45ac-bbc6-444303b3cac0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:42.132231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2a26-7237-441c-8424-49ac91148f84 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:42.192091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:42.193056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:42.194107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:42.194892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:42.195391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:42.195887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:42.196352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:42.196819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:42.197751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:42.198718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:42.200404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:42.200941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:42.203010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:42.212983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 68/144] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:42.221080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:42.235002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 77/145] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:41 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:42.248992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:42.386670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42246b-4d92-40c1-8287-26a442120749 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:42.437400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:42.438296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:42.438582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:42.438859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] PATH_INFO: `/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:42.444199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] RBAC: Authorizing `identity:get_user(user_id=7dfb7c853a6c4dcfabfc39df6e857d82)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:42.445722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:42.447501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 69/146] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:42 2022] GET /identity/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:42.453280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:42.584191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568754f-1f20-473a-9564-020c3fd4fda1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:42.599729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:42.620900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:42.622156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:42.622657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:42.623437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:42.624962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:42.626542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848dcd0-488d-41e3-b02d-848dc65be250 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:42.634308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 78/147] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:42 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:42.636461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:42.766597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:42.795112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8aae2-46a1-4691-878c-473219c1b548 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:42.853548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:42.854802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:42.855287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:42.855817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/7dfb7c853a6c4dcfabfc39df6e857d82/roles/ecf2040a2471456090a7677fc8bf172a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:42.858053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, user_id=7dfb7c853a6c4dcfabfc39df6e857d82, role_id=ecf2040a2471456090a7677fc8bf172a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:42.859741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7272307-aaea-411e-8e3f-b691ada5cb09 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:42.886523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 70/148] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:42 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/users/7dfb7c853a6c4dcfabfc39df6e857d82/roles/ecf2040a2471456090a7677fc8bf172a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:43.498822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d3a1-8eaf-48d8-bf79-671943e478c7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:43.499323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d3a1-8eaf-48d8-bf79-671943e478c7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:43.499433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7d3a1-8eaf-48d8-bf79-671943e478c7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:43.501040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 79/149] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:43.507227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:43.507706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:43.507904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:43.526051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:43.527267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:43.611199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 71/150] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:43.639732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7d3a1-8eaf-48d8-bf79-671943e478c7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:43.766479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7d3a1-8eaf-48d8-bf79-671943e478c7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:43.804584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:43.805416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:43.805705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:43.805986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:43.818311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:43.827406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:43.828304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:43.829068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 80/151] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:43.834149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:43.927231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:43.973841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e3d48-3a5a-4254-909c-d380f3e8b368 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:44.018760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:44.020070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.020354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.020813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.021584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:44.021904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:44.023317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:44.035741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 72/152] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:44.041479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:44.080929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:44.158321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca491238-3b12-4155-b85a-65b9ce450968 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:44.195926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:44.196870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.197163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.197442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] PATH_INFO: `/v3/users/b624fe749c804741bda23ecac0c46159` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.198717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] RBAC: Authorizing `identity:get_user(user_id=b624fe749c804741bda23ecac0c46159)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:44.200224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c8fb-5fa6-4a65-9cbd-d0d751846279 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:44.202266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 81/153] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:44 2022] GET /identity/v3/users/b624fe749c804741bda23ecac0c46159 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:44.207786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:44.320958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb1110-965f-465c-bade-4b120fd6c86f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:44.355731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:44.363242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0621e-de67-4b90-b187-72fb032779fc None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.363570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0621e-de67-4b90-b187-72fb032779fc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.364048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0621e-de67-4b90-b187-72fb032779fc None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.365704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 82/154] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:44.369005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:44.369733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.370084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.370362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.375167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05ae7-c621-4854-9fa9-d92b886b12a6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.375488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05ae7-c621-4854-9fa9-d92b886b12a6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.375770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc05ae7-c621-4854-9fa9-d92b886b12a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.404533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6dc05ae7-c621-4854-9fa9-d92b886b12a6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:44.406135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6dc05ae7-c621-4854-9fa9-d92b886b12a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:44.470105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:44.472113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:44.583674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 83/155] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:44.585874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9725d-c9e0-4f71-8263-b60806427633 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.586612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9725d-c9e0-4f71-8263-b60806427633 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.587099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9725d-c9e0-4f71-8263-b60806427633 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.588613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 84/156] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:44.593959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.594469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.594964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:44.624510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:44.626133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:44.660177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 73/157] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:13:44.661253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:44.684435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:44.747761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:44.782888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 85/158] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:44.783794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:44.857624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5487eb3-a998-48b9-9fd0-7ca68cf1019d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:44.949536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddde7-1344-4575-80e0-a61e267c85a9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:44.974346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:44.975224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:44.975540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:44.975815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.000285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:45.012492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:45.013494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:45.014268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 74/159] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:45.014945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.028098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.028989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.029276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.029554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.030904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:45.032397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:45.034108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 86/160] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:44 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:45.036454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.108631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:45.201491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:45.219042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c2ca-0d61-4e1b-84ac-a9f555a8763d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:45.270249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae80ff-28de-4f73-87dd-4b627ec1c6c3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:45.307249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.308116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.308400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.308670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.321201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:45.329469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:45.330424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:45.331198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 75/161] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:45.331997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.374829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.375459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.375746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.376026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.376792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:45.377100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:45.379144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8e5a3-b174-4c50-95eb-b389a649d651 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:45.398045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 87/162] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:45.403096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da637-a848-41d2-ab74-e30914c1a2c7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.403096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da637-a848-41d2-ab74-e30914c1a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.403287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576da637-a848-41d2-ab74-e30914c1a2c7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.405020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 88/163] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:45.405813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da637-a848-41d2-ab74-e30914c1a2c7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.507877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d16c4-c1e7-423b-86e3-f213e6b031a9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:45.513752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:45.523601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576da637-a848-41d2-ab74-e30914c1a2c7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:45.560270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.561236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.561695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.562176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.563099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:45.563603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:45.565150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:45.575325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 89/164] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:45.580608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.604101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.604780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.605072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.605350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.606202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=b624fe749c804741bda23ecac0c46159) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:45.606503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:45.608331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430641-6854-4ecd-8fb0-4eb58dd47b71 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:45.625941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 76/165] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/role_assignments?user.id=b624fe749c804741bda23ecac0c46159&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:45.628044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.628044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.628044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.668587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:45.669835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:45.699780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:45.790628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbcec0-58fb-410a-be31-a2902b6fbbff None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:45.792752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 77/166] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:45.793632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.858924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:45.859837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:45.860120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:45.860396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:45.861621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:45.863831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:45.865798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 90/167] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:45.866369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:45.932986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.017785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692468f1-68ae-4698-8e00-f3d7a02a4438 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.082320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.083499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.083791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.084073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.088197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:46.089858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:46.091876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 78/168] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:46.093104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.113627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d8d7b-d956-4c47-a3f6-8c84a6840b1c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.116007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.186858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.187617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.187909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.188184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.215309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:46.227741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:46.228662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 91/169] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:46.229886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.315282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077099d-d7ef-4c0f-9f0a-5e92ce6d83cc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.374419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.387945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.388613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.388900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.389179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.403819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d6fe-28aa-4027-91c1-9044caeb0abb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.464185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.465195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.465873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.467135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.482764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:46.484619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:46.505466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.605818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 79/170] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:46.607120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.624359 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:46.625831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:46.714396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125f80-9573-4305-a4b7-08684b27795d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.731792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.756395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.757079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.757364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.757640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.758405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:46.758709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:46.760172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:46.770420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 80/171] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:46.771229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.819740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:46.867027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 92/172] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:46.867929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.880566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc31bd-b17d-4e4b-a0ad-e786e412620e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:46.916588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:46.917462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:46.917748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:46.918024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:46.919250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:46.920749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:46.922484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 81/173] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:46.923347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:46.974169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.034024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42691e5-9a06-4e34-85fd-63235faa9c15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.070648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.071786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.072211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.072629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.074003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.075642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.077503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 82/174] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:47.078522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.097656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894fdf9-6c56-4a7a-b311-141067b83a53 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.170446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.171607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.172023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.172407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] PATH_INFO: `/v3/users/e16507240f7444d284829a7f1b8c20db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.173872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] RBAC: Authorizing `identity:get_user(user_id=e16507240f7444d284829a7f1b8c20db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.175581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ce927-940f-4f62-9a66-ddc4fc1daf2b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.178207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 93/175] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:46 2022] GET /identity/v3/users/e16507240f7444d284829a7f1b8c20db => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:47.184636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95897e5-e275-4792-9ec2-4b53c669e4d3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.185081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95897e5-e275-4792-9ec2-4b53c669e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.185468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95897e5-e275-4792-9ec2-4b53c669e4d3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.187504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 94/176] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:47.188131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95897e5-e275-4792-9ec2-4b53c669e4d3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.198096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dee5f5-7864-4c9f-b5ad-4091a5af4e4b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.220494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.264906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.265891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.266351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.266768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.267806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:47.268270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.270244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.290287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 83/177] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:47.290941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.291875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.417842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95897e5-e275-4792-9ec2-4b53c669e4d3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.424029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659288-16b8-4dc1-b92e-c56377a8fc13 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.464903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.465499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.465617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.465842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.466119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.466888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.467061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:47.467336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.467776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.468271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.469041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d8303-a9e1-4aca-9b15-4ed5bb596f36 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.476482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 95/178] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:47.477988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6f13-c557-49c5-bff1-cc57b88f5e90 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.478279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6f13-c557-49c5-bff1-cc57b88f5e90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.478555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6f13-c557-49c5-bff1-cc57b88f5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.497090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6a0a6f13-c557-49c5-bff1-cc57b88f5e90 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:47.498302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6a0a6f13-c557-49c5-bff1-cc57b88f5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:47.525245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.553845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.555802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456d173-f20a-4593-ae6f-31c889a118a2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.592408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 96/179] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:47.593981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfc7a-810f-404f-8164-4a9fc4be2edf None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.594274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfc7a-810f-404f-8164-4a9fc4be2edf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.594556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552dfc7a-810f-404f-8164-4a9fc4be2edf None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.596048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 97/180] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:47.597782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd60822-dfa4-4597-9a71-ff386a90243b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.598060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd60822-dfa4-4597-9a71-ff386a90243b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.598341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd60822-dfa4-4597-9a71-ff386a90243b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.599873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 98/181] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:47.600950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0fd9-4364-410f-994e-937e1f59004d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.601238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0fd9-4364-410f-994e-937e1f59004d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.601675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0fd9-4364-410f-994e-937e1f59004d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.603081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 99/182] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:47.608244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd3dc-a2fd-41ae-88c4-b46fb9374508 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.608244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd3dc-a2fd-41ae-88c4-b46fb9374508 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.608244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fd3dc-a2fd-41ae-88c4-b46fb9374508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.630016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-615fd3dc-a2fd-41ae-88c4-b46fb9374508 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:47.631399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-615fd3dc-a2fd-41ae-88c4-b46fb9374508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:47.684710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.689570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 84/183] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:47.689997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.690278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.690552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.710370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:47.711633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:47.721721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 100/184] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:47.723236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.723631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.723912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.743953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:47.745267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:47.790040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 85/185] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:47.791705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.801741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.825514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 101/186] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:47.826365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.904679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0029b-ce75-4a0c-ba78-fb0cc3e4fad9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.928649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa469bb-be64-40d9-bed5-dcf7be01a96e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:47.936573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:47.939221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.940240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.940522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.940795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.951517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:47.960076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:47.960960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 86/187] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:47.967124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:47.973525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:47.974397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:47.974679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:47.974946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] PATH_INFO: `/v3/projects/7a9e901be8e547f6bd8615c35b89b81b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:47.976180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] RBAC: Authorizing `identity:get_project(project_id=7a9e901be8e547f6bd8615c35b89b81b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:47.977613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:47.979304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 102/188] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/projects/7a9e901be8e547f6bd8615c35b89b81b => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:47.980075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.027654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.062692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba328b7-18e1-4bf2-8ee6-f605606cc120 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.079378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd8927-7f9b-4e9c-9b93-8dae9f7865dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.096311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.097094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.097376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.098234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.108253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:48.112752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.114133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.114416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.114690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:48.116268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:48.117130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:48.118098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 87/189] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:48.119420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.127699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:48.136044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:48.136962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:48.137754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 103/190] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:48.138587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.176462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.221847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ff7d7-148d-43b7-9013-07342e92442e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.242127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eae18c-bdc8-4838-90b5-aa8286018482 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.247843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.257004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.257991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.258434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.258708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.259936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.261407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.263200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 88/191] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.263833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.276367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.277038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.277323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.277600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.278354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:48.278669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.280080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.288674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 104/192] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.289455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.366927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7347-0d1d-462e-99f6-76c19fcd688f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.382670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.388419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5a5b4-47ca-4485-94c7-e333d6973309 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.401026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.401673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.401958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.402229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.403057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=7a9e901be8e547f6bd8615c35b89b81b, user.id=e16507240f7444d284829a7f1b8c20db) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:48.403386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.404831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.410584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 89/193] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/role_assignments?user.id=e16507240f7444d284829a7f1b8c20db&scope.project.id=7a9e901be8e547f6bd8615c35b89b81b&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.411381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.438587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.439714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.440158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.440437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.441219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:48.442161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.444091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.455172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 105/194] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.460362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.478594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.530167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002f2c7-b3ad-4807-9dd8-5aa10a9d67a8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.570654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.571722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.572145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.572561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.573467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:48.573818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3470-b27c-4372-8fe8-7b53ca8ea47e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.574091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.575770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.586756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 90/195] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.588302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.618881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.619670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.619956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.620277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.621052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.622967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.645337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 106/196] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:48 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:48.647406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.668089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.716555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a752a7f-1263-4738-b1bb-cb0d2008ced4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.739299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:48.755906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.756952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.757237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.757510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] PATH_INFO: `/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.758799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] RBAC: Authorizing `identity:get_user(user_id=7dfb7c853a6c4dcfabfc39df6e857d82)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.760381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.762094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 91/197] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/users/7dfb7c853a6c4dcfabfc39df6e857d82 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.762893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.789800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b037d-964e-442e-94d7-4db7019641bf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.835697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.836596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.837163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.837444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.856954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.858434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.860462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 107/198] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.861140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.884364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9add151-7b2e-45df-b4a5-6bff16ef6370 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:48.927084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:48.928034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:48.928347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:48.928623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:48.930060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:48.931556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:48.935697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 92/199] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:48.936546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:48.963703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.003830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.006159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41a33f-9705-4f73-979e-281ea1e6d48c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.052733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.053821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.054378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.054662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.064553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e616e-5f08-4919-bdd0-41c184cb9535 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.103387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.104185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.104539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.104889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.142661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.144215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.195101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.196745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.220401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.254837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 108/200] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:49.259715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.260102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.312247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 93/201] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:49.313173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.388364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d3c2c-e3ae-4ff9-99d6-8d71c7f96fbd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.434592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.435329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.435701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.436043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.437727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c03023-3dc6-4cd0-8e7d-67fa0eb453d7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.473552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.474505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.474798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.475070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.476428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.477979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.480073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 94/202] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:49.480962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.482406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.508471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.513077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.514962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.589377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc96f2-5e8d-43fb-9545-b338be19d7a3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.625682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.626278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 109/203] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:49.626549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.626832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.627106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.627223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.628534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.630209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.636804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 95/204] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:49.637698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.702045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.734645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fe41-7728-4f8d-bcd1-364b8fb5bfd9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.737888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.747404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d74e4a-0ea2-4283-b62d-5b9cbbb53679 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.773305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.773967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.774248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.774519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.775503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, scope.project.id=2f523bbc54e641faab62cb271e8bfe62, user.id=7dfb7c853a6c4dcfabfc39df6e857d82) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:49.775814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.777349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.783901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 110/205] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/role_assignments?user.id=7dfb7c853a6c4dcfabfc39df6e857d82&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=ecf2040a2471456090a7677fc8bf172a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:49.784017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.784690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.784863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.785142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.785938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.787141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.788879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.790694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 96/206] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:49.796579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:49.901278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f6aba-2288-45db-9420-07c2e4be7652 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.916886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbcd9a-d7b0-400c-adff-2292c2973cb9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:49.939705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.940498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.940784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.941060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.942169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=9fbfc3a5d61145eea93d85925ce2cdfb) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:49.942732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.944498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79e9c8-c48b-46a3-a0b1-92d428befc08 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.948684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:49.952205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 111/207] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/role_assignments?user.id=9fbfc3a5d61145eea93d85925ce2cdfb&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:49.975656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:49.976345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:49.976629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:49.976902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:49.977842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=9fbfc3a5d61145eea93d85925ce2cdfb) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:49.978151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:49.979759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356556a4-196e-470d-93cc-bb81abb4115f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:49.993166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 97/208] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:49 2022] GET /identity/v3/role_assignments?user.id=9fbfc3a5d61145eea93d85925ce2cdfb&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:51.088093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99438-56a2-411a-a2e6-b5e84c341f25 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.088755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99438-56a2-411a-a2e6-b5e84c341f25 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.088755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99438-56a2-411a-a2e6-b5e84c341f25 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.090098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 112/209] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:51.097160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.097160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.097160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.114197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:51.115704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:51.138444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:51.175016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4d8d-3ffb-41cf-953a-a9367fbb48a2 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.175319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4d8d-3ffb-41cf-953a-a9367fbb48a2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.175609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d4d8d-3ffb-41cf-953a-a9367fbb48a2 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.177400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 113/210] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:51.182456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.182751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.183034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.191438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 98/211] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:51.202168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:51.203474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:51.216835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.286396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 114/212] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:51.311355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.343770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1140eb-8735-4d66-aca2-6afd0326483a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.384736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.385910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.386329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.386737 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.404106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:51.414057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:51.414999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:51.415995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 99/213] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:51.422230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.435475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d9a6-5520-465c-a8ef-8d915111a152 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.440256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:51.469891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:51.477620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.478618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.478909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.479188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.480419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:51.482009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:51.488358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 115/214] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:51.489365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.529626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339659c9-20d2-4844-9787-93bb8362b5aa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.564470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.565271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.565624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.565968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.566962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:51.567459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:51.569256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:51.578618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 100/215] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:51.585065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.600711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad43bf-0073-4869-ac6e-055865c9756c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.639487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.640169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.640472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.640824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.641549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:51.643006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:51.667400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 116/216] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:51 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:13:51.674625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:51.707068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66c241-a0b3-43b9-9604-7d4ece0716ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.747975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.748872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.749151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.749411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] PATH_INFO: `/v3/users/3bcb0ab4caf447b288cf5763f43ccd41` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:51.766405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] RBAC: Authorizing `identity:get_user(user_id=3bcb0ab4caf447b288cf5763f43ccd41)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:51.768032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:51.770111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 101/217] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:51 2022] GET /identity/v3/users/3bcb0ab4caf447b288cf5763f43ccd41 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:51.776096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:51.841412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:51.894281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c9d1c-933b-4db6-9112-bdf61ff99d2a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:51.930594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:51.931261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:51.931602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:51.931882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.005144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:52.006675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:52.063776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:52.114879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 117/218] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:52.120304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:52.239548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ede68b-ee0d-47ed-8f0b-6dce2a9893bd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:52.276202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:52.277037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.277319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.277595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.278804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:52.280311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9491e14-b563-401f-aee4-9cfd95d95801 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:52.282281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 102/219] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:52 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:52.287942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:52.371986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def48210-7359-4aa7-a53d-fc2e63c88a9d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.372615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def48210-7359-4aa7-a53d-fc2e63c88a9d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.373109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def48210-7359-4aa7-a53d-fc2e63c88a9d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.374717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 103/220] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:52.387141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8a1b-8a79-47a5-811f-3feed79eb65d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.387751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8a1b-8a79-47a5-811f-3feed79eb65d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.388224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff8a1b-8a79-47a5-811f-3feed79eb65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.393655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:52.407325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9dff8a1b-8a79-47a5-811f-3feed79eb65d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:52.408861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9dff8a1b-8a79-47a5-811f-3feed79eb65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:52.455402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f7e25-913d-4dc0-a8d3-b948c9ddcbd7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:52.489102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 104/221] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:52.490916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986afdb0-7dc4-49b9-adc6-1dad96dee933 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.491542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986afdb0-7dc4-49b9-adc6-1dad96dee933 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.492047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986afdb0-7dc4-49b9-adc6-1dad96dee933 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.493831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 105/222] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:52.500209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:52.501129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.501650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.502144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.503243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=3bcb0ab4caf447b288cf5763f43ccd41) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:52.503788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:52.506466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:52.513164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 118/223] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:52 2022] GET /identity/v3/role_assignments?user.id=3bcb0ab4caf447b288cf5763f43ccd41&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:52.521244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:52.522198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.522686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.523163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.550711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:52.552666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:52.571759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:52.687380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 106/224] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:52.707522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f936c-35d3-4e7c-af38-e8ed40472229 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:52.722816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:52.773661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:52.774821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.775104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.775427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.790396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:52.800859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:52.802366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:52.803161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 119/225] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:52.810960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:52.818417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:52.893506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a1ef-e77a-4568-af8a-a4145d255300 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:52.915330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:52.943343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309c946-ee2d-4841-903d-6a27a3262ba3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:52.974387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:52.975190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.977822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.978113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.996056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:52.996744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:52.997004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:52.997279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:52.998058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:52.998341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.002753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:53.007581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:53.016697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:53.017601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:53.018417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 107/226] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:53.022195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 120/227] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:53.028930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.030148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.198063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131fad-0664-4cc1-a2c3-63297a51741c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.225624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:53.247329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.248367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.248848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.250590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.251623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:53.252133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.253803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.266095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 108/228] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:53.272511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.289594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5d0d-fefe-42b8-9c81-a866b65b561c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.387861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a1f2-2ef0-4a47-8f9e-ed94cabf6f9d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.395854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.396918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.397141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.397368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.404087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.405561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.407536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 121/229] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:53 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:53.413507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.431956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:53.438389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.439319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.439957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.440243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.441639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.444151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.446447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 109/230] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:53 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:53.451758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.545480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:53.615862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec24fea-b044-49c7-9887-eda256944d88 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.649373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0005-2a6e-445c-85c9-2ce5e289fce6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.651872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.652853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.653242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.653622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.654934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.656676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.658840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 122/231] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:53 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:53.664725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.716092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.716980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.717270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.717554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.718819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.720332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.722076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 110/232] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:53 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:53.728827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:53.776833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f179-4447-4caf-b96a-0bcc9fb20811 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.791802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:53.816042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940caae-0502-4213-9143-587d54321853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.817085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940caae-0502-4213-9143-587d54321853 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.817713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940caae-0502-4213-9143-587d54321853 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.817713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940caae-0502-4213-9143-587d54321853 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/9fbfc3a5d61145eea93d85925ce2cdfb/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.820507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940caae-0502-4213-9143-587d54321853 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, user_id=9fbfc3a5d61145eea93d85925ce2cdfb, role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.822160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940caae-0502-4213-9143-587d54321853 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.840803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 123/233] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:53 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/9fbfc3a5d61145eea93d85925ce2cdfb/roles/e44bbee3e1df41568b635760aa1e44dd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:13:53.902153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b83fbc-837f-44ff-8d55-aeda5716273d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:53.927439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:53.945880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:53.946843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:53.947136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:53.947442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/9fbfc3a5d61145eea93d85925ce2cdfb/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:53.949824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, user_id=9fbfc3a5d61145eea93d85925ce2cdfb, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:53.951309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56b40c-6a36-4e95-8b07-fc240c91efcf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:53.971122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 111/234] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:53 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/9fbfc3a5d61145eea93d85925ce2cdfb/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:54.420170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc138bf-387d-43fc-b93d-e423cae68038 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:54.420692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc138bf-387d-43fc-b93d-e423cae68038 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:54.421015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc138bf-387d-43fc-b93d-e423cae68038 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:54.422787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 124/235] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:54.428776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9fabb-0733-43b8-8a71-911f7b6c0ad3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:54.429217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9fabb-0733-43b8-8a71-911f7b6c0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:54.429577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9fabb-0733-43b8-8a71-911f7b6c0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:54.452400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ac9fabb-0733-43b8-8a71-911f7b6c0ad3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:54.453596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ac9fabb-0733-43b8-8a71-911f7b6c0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:54.546229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 112/236] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:54.588058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc138bf-387d-43fc-b93d-e423cae68038 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:54.724487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc138bf-387d-43fc-b93d-e423cae68038 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:54.776629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:54.777431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:54.777718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:54.777994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:54.781235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:54.795556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:54.801850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443088-00e8-4440-85df-40e1a87f1a91 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:54.802149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443088-00e8-4440-85df-40e1a87f1a91 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:54.802509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443088-00e8-4440-85df-40e1a87f1a91 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-86f62073-787e-4d63-9015-9a4545cbb179 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:54.803628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:54.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:54.805259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:54.805847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 113/237] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:13:54.805923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 125/238] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:54.813032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443088-00e8-4440-85df-40e1a87f1a91 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:54.815247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:54.815571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:54.816099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:54.855979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:54.857172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:54.972596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443088-00e8-4440-85df-40e1a87f1a91 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.000579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.028600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 126/239] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:55.050882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.052157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.052442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.052723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.053490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:55.053797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.055392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.060482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.072323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 114/240] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:55.077934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.205940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e8db6-0c8f-46b4-9383-a952a8a8c905 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.211796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b305b0-8561-46fa-bfaf-0724837064dc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.235325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.253885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.256506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.257002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.257489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.260555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.262348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee2efe-503d-4e7d-823d-0a95284e57e6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.264029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 127/241] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:55.265317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749ddf-61cc-4df9-ad2d-f0bb4b55b784 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.265599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749ddf-61cc-4df9-ad2d-f0bb4b55b784 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.265768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.266177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749ddf-61cc-4df9-ad2d-f0bb4b55b784 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.266864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.267250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.267642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] PATH_INFO: `/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.268535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 128/242] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:55.269481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749ddf-61cc-4df9-ad2d-f0bb4b55b784 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.287082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.289501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd3f67-766e-49d3-a438-55fd16f531d8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.291669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 115/243] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:55.293137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.293590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.294030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.316679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:55.319067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:55.354027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.387112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749ddf-61cc-4df9-ad2d-f0bb4b55b784 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.415442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 116/244] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:55.417522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.435419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.436756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.437318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.437831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.438861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.440986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.464833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 129/245] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:13:55 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:13:55.466114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.532229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.561968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4b8d4-abfe-4143-972c-7fd26130d11b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.595853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29574-1eac-4e68-9881-899dfb970263 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.636203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.637131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.637904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.638862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.639388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.639802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.640423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.641415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.667751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:55.681545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:55.682663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:55.683781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:55.688761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 130/246] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:55.693923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.705984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.761071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.762561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.869001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905084ba-848a-4c09-a1db-51a6b8a36111 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:55.881209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:55.889959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 117/247] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:55.900962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.916168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:55.916854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:55.917191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:55.917488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:55.918242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:55.918554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:55.921617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:55.933435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 131/248] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:55.938859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:55.984342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:56.041544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152068-f6c6-44c7-ab2b-95819e1ed95c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:56.083020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b88e-62bb-461a-ba87-0e587187985e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:56.085307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:56.086456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.087976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.088560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.090043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:56.091873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:56.093805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 118/249] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:56.099808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:56.130473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:56.131406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.131702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.131984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] PATH_INFO: `/v3/users/3bcb0ab4caf447b288cf5763f43ccd41` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.134349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3bcb0ab4caf447b288cf5763f43ccd41)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:56.136672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:56.138883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 132/250] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:55 2022] GET /identity/v3/users/3bcb0ab4caf447b288cf5763f43ccd41 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:56.144758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:56.196380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:56.226461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead5078-12af-4f56-8b54-c36908126224 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:56.255845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:56.262625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98392503-5240-4be3-9dc3-e071ae82c9a8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:56.265284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:56.266193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.266755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.268070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.269117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:56.269625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:56.271543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:56.278348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 119/251] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:56 2022] GET /identity/v3/role_assignments?user.id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=ecf2040a2471456090a7677fc8bf172a => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:56.300854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:56.302507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.302796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.303194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.304668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:56.306159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183e309-0be7-4f1f-80d3-3cc12cee137b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:56.308025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 133/252] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:56 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:56.314075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:56.442531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381d43-6b79-4477-aa22-b437189cbe22 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:56.493147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:56.494138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.494465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.494745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/3bcb0ab4caf447b288cf5763f43ccd41/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.499581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, user_id=3bcb0ab4caf447b288cf5763f43ccd41, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:56.501171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace05c0b-c9e1-4d30-bc7c-89aa6cdc8c31 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:56.520024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 120/253] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:13:56 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/3bcb0ab4caf447b288cf5763f43ccd41/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:13:56.712514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292800-8681-44b1-8aa6-8855290f046a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.713279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292800-8681-44b1-8aa6-8855290f046a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.713356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91292800-8681-44b1-8aa6-8855290f046a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.714741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 134/254] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:56.720968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.721248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.721523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.724269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3dd5-33ce-4fcf-adae-1ec96f8722cf None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.724819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3dd5-33ce-4fcf-adae-1ec96f8722cf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.726202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a3dd5-33ce-4fcf-adae-1ec96f8722cf None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.735647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 121/255] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:56 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:56.737113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:56.737397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:56.737672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:56.757215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:56.759632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:56.787073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:56.788514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:56.889271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:56.893971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 135/256] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:13:56.922237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 122/257] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:56.935086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:56.946109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:56.980689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:57.090482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32957b-1b2d-454a-ae71-1a4b3b62906a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.145056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.146882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.147166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.147506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.176372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:57.184745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:57.185644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:57.186884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 136/258] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:13:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:57.193636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.200636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e327-72f2-4f98-adf9-12860248342b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.298231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.298958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.299249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.299550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.332337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:57.340541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:57.341424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:57.342642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 123/259] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:13:57.347637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.415682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:57.419266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b7676-238c-4981-8911-8feba9bf14dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.443845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:57.482194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.482874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.483156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.483453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.484221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:57.484529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:57.485921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:57.502073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 137/260] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:57.508075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.551610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba87d02-c41a-4268-9cbc-ccad4f4051ff None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.593253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.594203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.594501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.594777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.595568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:57.595880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:57.597453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:57.607511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 124/261] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:57.613214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.711477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6b1e4-c721-4a6c-8335-52d03898a348 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.761247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc211-8eb0-4b14-941d-56afe3e87bd1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:57.771255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:57.782335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.783269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.783527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.783821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.785746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:57.787890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:57.791311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 138/262] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:57.795987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.840965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:57.841851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:57.842133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:57.842404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] PATH_INFO: `/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:57.844814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] RBAC: Authorizing `identity:get_user(user_id=9fbfc3a5d61145eea93d85925ce2cdfb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:57.846277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:57.847949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 125/263] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/users/9fbfc3a5d61145eea93d85925ce2cdfb => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:57.854411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:57.854984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:57.984862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd2e8e-ee67-4f11-82f7-18f9523ef132 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:58.022411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:58.023068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:58.023828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:58.024118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:58.061580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544348-c9a8-4b2e-813d-60077468c153 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:58.073933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:58.102105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:58.103921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:58.164097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:58.164776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:58.165062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:58.165344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:58.288444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 126/264] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:58.304662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:58.352521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:58.353945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:58.416884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:58.440547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:58.459757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb98f-014b-4797-b4bc-8114d7222e95 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:58.564162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:58.565049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:58.565337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:58.565616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:58.566874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:58.568621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:58.570366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 127/265] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:58 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:58.574930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 139/266] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:13:58.580311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:58.581055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:58.731679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dec73-a071-461f-89b2-c5d56e451328 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:58.788111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:58.788998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:58.789286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:58.789564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:58.790806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:58.792332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:58.794231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 128/267] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:13:58 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:58.799663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:58.815241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f38ec-ee35-4ace-a4f7-c41bc7bb4d04 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:58.831753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:58.864213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:58.885495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:58.886167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:58.886457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:58.886739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:58.887618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=9fbfc3a5d61145eea93d85925ce2cdfb) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:58.887933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:58.889390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2034640-af3b-4b25-99a9-f3324d89d4c0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:58.901350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 140/268] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:58 2022] GET /identity/v3/role_assignments?user.id=9fbfc3a5d61145eea93d85925ce2cdfb&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:59.009194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415507c5-5a99-4ec3-bdfb-4ead2c3b7b78 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:59.060592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:59.061263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.061544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.061818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.062657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=9fbfc3a5d61145eea93d85925ce2cdfb) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:59.062969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:59.064457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7790c-5e3f-421d-973e-a7dbf1f1d1b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:59.074317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 129/269] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:13:58 2022] GET /identity/v3/role_assignments?user.id=9fbfc3a5d61145eea93d85925ce2cdfb&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:13:59.291246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fda5f8-fb86-4e30-8aa0-f1981823044c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.291469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fda5f8-fb86-4e30-8aa0-f1981823044c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.291739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fda5f8-fb86-4e30-8aa0-f1981823044c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.293450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 141/270] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:59.299015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545806-a67b-4832-9582-4cc125cc32d8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.299449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545806-a67b-4832-9582-4cc125cc32d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.299728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08545806-a67b-4832-9582-4cc125cc32d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.322768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-08545806-a67b-4832-9582-4cc125cc32d8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:59.324022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08545806-a67b-4832-9582-4cc125cc32d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:59.409647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 130/271] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:59.410156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5154-5244-49b6-b678-51e6e56b3129 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.410520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5154-5244-49b6-b678-51e6e56b3129 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.410807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5154-5244-49b6-b678-51e6e56b3129 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.412518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 142/272] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:59.418278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.418900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.419452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.425089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:59.441619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:59.443884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:59.447170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f5154-5244-49b6-b678-51e6e56b3129 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:59.550097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 131/273] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:59.577645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:59.602203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f5154-5244-49b6-b678-51e6e56b3129 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:59.645433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:59.646774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.647052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.647326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.659566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-29a3c87f-0759-4a5d-a46e-d3257b3c83e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:59.669907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:59.670821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:13:59.671637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:13:59.672238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 143/274] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:59.675422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817dc11-9faf-49a5-a7a4-c78dc4710da5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.675422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817dc11-9faf-49a5-a7a4-c78dc4710da5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.675422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817dc11-9faf-49a5-a7a4-c78dc4710da5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.677161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 144/275] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:13:59.678263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817dc11-9faf-49a5-a7a4-c78dc4710da5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:59.702088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef57d5-0882-4781-8225-e78d0e372d6a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:59.734744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:59.740791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:59.741980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.742506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.743181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.749273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:13:59.755571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-081f599b-314f-48c9-ae7d-108c1060f35f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:13:59.763340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:13:59.764260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 132/276] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:13:59.765953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.766683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.766683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.783555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:13:59.784731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:13:59.808255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817dc11-9faf-49a5-a7a4-c78dc4710da5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:59.849673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:13:59.850685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:13:59.850791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:13:59.850993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:13:59.851779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:13:59.852091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:13:59.853481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:13:59.858231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 133/277] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:13:59.858915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:59.863819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 145/278] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:13:59.869205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:13:59.975021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be2659-31e3-4957-b2c5-aefc816a9b1c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:13:59.987485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4705-7580-40a6-90de-c2ab9f075e95 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.003042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.006720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.019623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.020326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.020819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.020925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.021732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:00.021969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.023436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.027468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.028875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.029303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.029723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] PATH_INFO: `/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.031549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] RBAC: Authorizing `identity:get_user(user_id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.037607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 134/279] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.037607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.037823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.037823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 146/280] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:13:59 2022] GET /identity/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.044548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.143207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8578a1-fb47-4c30-978a-efd76d31a2da None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.158090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0445-8a64-4c9f-8bbb-7c898169b5de None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.176946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.178311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.178595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.178873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.180150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.181621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.183254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 135/281] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.184053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.191792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.192702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.192987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.193265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] PATH_INFO: `/v3/users/f9ead2aa7b2845018a16abb6826a428f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.206667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] RBAC: Authorizing `identity:get_user(user_id=f9ead2aa7b2845018a16abb6826a428f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.208195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c7f45-9a9f-43d4-9779-4d1bdc325f8f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.209861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 147/282] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/users/f9ead2aa7b2845018a16abb6826a428f => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.211135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c87c-5184-4311-8d4e-bfd873502e70 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.211458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c87c-5184-4311-8d4e-bfd873502e70 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.211741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522c87c-5184-4311-8d4e-bfd873502e70 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.213535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 148/283] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:00.214241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c87c-5184-4311-8d4e-bfd873502e70 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.243598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.258277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.291197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad47fbc-5547-4703-9408-6a066d7ccd15 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.317021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522c87c-5184-4311-8d4e-bfd873502e70 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.325823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.326684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.326969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.327246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.328473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.329955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.331715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 136/284] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.332565 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.353867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.354810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.355089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.355383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.356110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.357555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d1904-a1e5-4aa3-a145-1bc71673e3e8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.378083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 149/285] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:00 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:00.379544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.379839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.380157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.398159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:00.399310 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:00.449293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384aa07-67bc-4410-9ff5-185fdca4f20e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.472584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.487397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 150/286] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:00.487397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.503183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.503910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.504198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.504476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.505971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, user.id=f9ead2aa7b2845018a16abb6826a428f, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:00.506293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.507946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.514424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 137/287] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/role_assignments?user.id=f9ead2aa7b2845018a16abb6826a428f&scope.system=all&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.515350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.518677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.619493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee11e7-dbbf-47e5-9b2a-a36e451c80d0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.665104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d65f0-61e7-4e69-af58-659b084d73f1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.668341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.669266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.669549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.669828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed/roles/ecf2040a2471456090a7677fc8bf172a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.672079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, user_id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed, role_id=ecf2040a2471456090a7677fc8bf172a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.673587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.694051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 151/288] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:00 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed/roles/ecf2040a2471456090a7677fc8bf172a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:00.718752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.719965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.720441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.720932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.735931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:00.744628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:00.745569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:00.746404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:00.748589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 138/289] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:00.754722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:00.865379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:00.885639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146efc9-9f5d-4ec1-a22b-06f324460ed4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:00.923972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:00.924640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:00.924930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:00.925210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:00.925972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:00.926278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:00.927837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:00.937300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 152/290] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:00.942351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:01.017969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:01.094241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccbe3-e9c5-4650-b6c7-799bf77d7148 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:01.144249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:01.145138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:01.145425 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:01.146290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] PATH_INFO: `/v3/users/3bcb0ab4caf447b288cf5763f43ccd41` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:01.147670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] RBAC: Authorizing `identity:get_user(user_id=3bcb0ab4caf447b288cf5763f43ccd41)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:01.149246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:01.155032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 139/291] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:00 2022] GET /identity/v3/users/3bcb0ab4caf447b288cf5763f43ccd41 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:01.156765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:01.293939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de5d59-7fec-4777-9d55-e598b0aa332e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:01.349792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:01.350460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:01.350744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:01.351018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:01.392841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:01.469948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:01.472356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:01.653730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 153/292] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:01.660006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:01.843216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb530eb-340c-4ebc-8f3d-f09ef13b4254 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:01.862368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:01.897703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:01.898603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:01.898889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:01.899165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:01.900481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:01.901957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c09071-8381-465e-9421-d8ee73616e8b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:01.904032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 140/293] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:01 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:01.910338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:02.000224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:02.077518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab9cf-c7da-4371-bc4a-461b1c440c9a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:02.136492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:02.137174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:02.137463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:02.137743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:02.138600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=3bcb0ab4caf447b288cf5763f43ccd41) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:02.138914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:02.140427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feeaea-be69-4913-bb1f-9a7a0530dccf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:02.153903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 154/294] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:01 2022] GET /identity/v3/role_assignments?user.id=3bcb0ab4caf447b288cf5763f43ccd41&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:03.259526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eebb-2ce5-4860-94bc-9bb63a3ee8bb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.260055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eebb-2ce5-4860-94bc-9bb63a3ee8bb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.260131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04eebb-2ce5-4860-94bc-9bb63a3ee8bb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.261958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 141/295] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:03.267346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d029-6cab-46c6-8021-daa825ea36a4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.267878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d029-6cab-46c6-8021-daa825ea36a4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.267953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d029-6cab-46c6-8021-daa825ea36a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.290950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-51b9d029-6cab-46c6-8021-daa825ea36a4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:03.292183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-51b9d029-6cab-46c6-8021-daa825ea36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:03.312911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92bbc5-3b5a-473d-b596-e478192577a1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.313220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92bbc5-3b5a-473d-b596-e478192577a1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.313481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92bbc5-3b5a-473d-b596-e478192577a1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.315132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 142/296] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:03.320908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.321227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.321540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.340028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:03.341222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:03.375414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 155/297] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:03.375694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915c83-d3b0-4985-8f92-8fc723b348bf None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.375992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915c83-d3b0-4985-8f92-8fc723b348bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.376274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9915c83-d3b0-4985-8f92-8fc723b348bf None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.377669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 156/298] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:03.382841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.383135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.383447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.404754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:03.406486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:03.420616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 143/299] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:03.421476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.454273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:03.487659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 157/300] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:03.488309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.536134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310d338-8a3a-40a0-bd33-73bc671f0a08 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.548033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:03.573122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.573914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.574196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.574471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.585359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:03.590953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff072-d8a8-44e6-8e1b-28425bb6a79e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b7b4e006-2f51-4a9e-86aa-b781d1e3883c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:03.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:03.594342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:03.595137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 144/301] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:03.596247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f71d-0e2b-4d36-977f-045f0463a941 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.596247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f71d-0e2b-4d36-977f-045f0463a941 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.596407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f71d-0e2b-4d36-977f-045f0463a941 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.597667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 145/302] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:03.598368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f71d-0e2b-4d36-977f-045f0463a941 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.631013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.631879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.632168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.632451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.643260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:03.651968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:03.652993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:03.653814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 158/303] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:03.654461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.684991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:03.705552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f71d-0e2b-4d36-977f-045f0463a941 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.740006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.740796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.741086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.741363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.742543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:03.744063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5b217-9e35-4a67-a442-ff412c449b4a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:03.745705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 146/304] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:03.746914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.747200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.747508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.757968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473e5f7-a82b-44b0-b651-d76fbf5aa4e5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.765190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:03.766364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:03.792387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.792982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.793271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.793556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.794306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:03.794618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:03.796024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:03.796979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:03.804688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 159/305] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:03.805576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.844828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 147/306] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:03.845668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.902951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:03.910325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7affd-ff67-484c-a407-1dad62ef97c2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.945181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.945940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.946234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.946512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.947265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:03.947596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:03.948968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:03.951812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008db8-58de-47a9-809a-4f87c2a7b653 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:03.957012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 160/307] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:03.957803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:03.986391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:03.987094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:03.987410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:03.987694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:03.988384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:03.990099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.004814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 148/308] 10.222.0.46 () {60 vars in 1134 bytes} [Mon May 23 15:14:03 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:04.006065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.038881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:04.089946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca09d7-c58d-4243-8743-be76904bdd56 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.120613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be6ec-272b-4715-8c59-de19a0364376 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.128347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.129266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.129557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.129835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] PATH_INFO: `/v3/users/affaec817b154519bd0daa4f9d2b6924` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.146508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] RBAC: Authorizing `identity:get_user(user_id=affaec817b154519bd0daa4f9d2b6924)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.148187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.150235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 161/309] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:03 2022] GET /identity/v3/users/affaec817b154519bd0daa4f9d2b6924 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:04.151030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.163038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.163907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.164195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.164473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.169173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:04.177108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:04.185810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:04.186807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:04.187951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 149/310] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:04.188827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.275909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828203cd-2ae5-40ea-8132-7f6613843abc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.282444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:04.296545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ec33-1768-4155-be42-840f2f0f3225 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.312925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.313804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.314094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.314373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] PATH_INFO: `/v3/users/f9ead2aa7b2845018a16abb6826a428f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.315614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] RBAC: Authorizing `identity:get_user(user_id=f9ead2aa7b2845018a16abb6826a428f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.317060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.323458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 162/311] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/users/f9ead2aa7b2845018a16abb6826a428f => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:04.323458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.336841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.337505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.337794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.338071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.339154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, user.id=affaec817b154519bd0daa4f9d2b6924, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:04.339504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.341028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.346386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 150/312] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/role_assignments?user.id=affaec817b154519bd0daa4f9d2b6924&scope.system=all&role.id=ecf2040a2471456090a7677fc8bf172a => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:04.347149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.435182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:04.459184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f538c34-7280-4a66-9ee7-46e5cf4d4221 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.479003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124af975-ac19-4412-977e-e74ba0d0e1c5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.502497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.503469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.503936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.504362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.505351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:04.505951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.507705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.518655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.518962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 163/313] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:04.523522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.523522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.523522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] PATH_INFO: `/v3/system/users/f9ead2aa7b2845018a16abb6826a428f/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.524295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f9ead2aa7b2845018a16abb6826a428f, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.525716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.528410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.538018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 151/314] 10.222.0.46 () {58 vars in 1334 bytes} [Mon May 23 15:14:04 2022] PUT /identity/v3/system/users/f9ead2aa7b2845018a16abb6826a428f/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:04.651677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cf209-355c-41c7-9463-eee6f1fe4180 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.689665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.690869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.691329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.691805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] PATH_INFO: `/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.694029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.695862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.698067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 164/315] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/users/3f8fc85e3d4f4e8f91fafd6e5d8bdaed => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:04.704613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:04.726796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:04.816511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab2b5-514a-4220-8885-7173b21bc39d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:04.852809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:04.853472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:04.853759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:04.854035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:04.928437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:04.929843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:04.952136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:05.034531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 152/316] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:05.040503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:05.056522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:05.144999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af139e5a-b21a-46c5-be83-6a0521b6c2d9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:05.182196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:05.183451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:05.183927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:05.184392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:05.185788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:05.187457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243e71a-c5ac-4920-bcb0-f98be45fadf5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:05.189668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 165/317] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:05 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:05.195929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:05.302207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e641a-ec58-47c4-8b2e-9dd7e589308f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:05.320170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:05.339235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:05.339940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:05.340229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:05.340567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:05.341444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, scope.project.id=9ebb568211b349f1a08083e14d85f98d, user.id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:05.341764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:05.343223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df01b51-5cad-43af-b365-18b07d60a31a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:05.355550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 153/318] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:05 2022] GET /identity/v3/role_assignments?user.id=3f8fc85e3d4f4e8f91fafd6e5d8bdaed&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=ecf2040a2471456090a7677fc8bf172a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:06.284511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c58e-bd81-4712-b436-85beab466df6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.285074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c58e-bd81-4712-b436-85beab466df6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.285074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618c58e-bd81-4712-b436-85beab466df6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.286612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 166/319] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:06.291756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b098479-6098-458e-8bba-35d40240e91c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.292051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b098479-6098-458e-8bba-35d40240e91c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.292329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b098479-6098-458e-8bba-35d40240e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.310114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0b098479-6098-458e-8bba-35d40240e91c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:06.311311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0b098479-6098-458e-8bba-35d40240e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:06.378138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 154/320] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:06.401342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c58e-bd81-4712-b436-85beab466df6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:06.490721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:06.513346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618c58e-bd81-4712-b436-85beab466df6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:06.548413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:06.549418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.549847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.550271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.551645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:06.553892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123aeba-5f14-4073-b316-4926704ae226 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:06.556088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 167/321] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:06.561480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b098479-6098-458e-8bba-35d40240e91c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:06.626162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde579-8a5f-46b9-a264-7aeaacbc0304 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.626540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde579-8a5f-46b9-a264-7aeaacbc0304 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.626770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbde579-8a5f-46b9-a264-7aeaacbc0304 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.628381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 168/322] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:06.634011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.634307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.634591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.651478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:06.652726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:06.673425 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b098479-6098-458e-8bba-35d40240e91c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:06.688620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:06.717842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:06.718516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.718802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.719080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] PATH_INFO: `/v3/groups` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.719801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:06.721264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe63bae-b6f5-4d81-9c12-a43f6e5f976b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:06.727398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 169/323] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:06.738585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 155/324] 10.222.0.46 () {60 vars in 1134 bytes} [Mon May 23 15:14:06 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:14:06.754604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:06.849992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:06.859410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440046e-9794-4f5d-aac1-1a9706b762ce None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.859723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440046e-9794-4f5d-aac1-1a9706b762ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.859983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440046e-9794-4f5d-aac1-1a9706b762ce None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.861639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 156/325] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:06.867884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.868169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.868456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.875217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a271c-a288-4c89-b2f1-b2d395be4d55 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:06.886409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:06.887675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:06.915619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:06.916600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:06.916711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:06.916986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:06.929195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:06.937077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:06.937989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:06.938778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 170/326] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:06.945223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:06.972469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 157/327] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:06.996070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.063738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a8502-ffa5-4ce8-95de-1d4c800ebd4c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.116420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.117843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.117843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.117843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.118629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:07.118943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.120987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.122918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:07.126295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd55e7-bd4c-4d09-bc13-dd5f0d2cd552 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.127737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:07.135083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 171/328] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:07.140347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.182096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.182912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.183198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.183501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.201704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:07.210192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:07.211132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:07.214542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 158/329] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:07.219171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.290776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9ebe-b185-4b3a-a13f-7424dd85269b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.336664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.337629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.337968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.338257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] PATH_INFO: `/v3/users/affaec817b154519bd0daa4f9d2b6924` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.339784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=affaec817b154519bd0daa4f9d2b6924)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.341408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.343442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 172/330] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:07 2022] GET /identity/v3/users/affaec817b154519bd0daa4f9d2b6924 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:07.345691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e771e-5d0c-49d0-a01c-4e3ae7578fde None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.349499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.385909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.386586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.386872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.387185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.387999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:07.388311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.389740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.403503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 159/331] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:07.405634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.435862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:07.440781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:07.490543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79306c68-c756-4db0-933e-4b4979b19fc9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.523330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea0d2-0f8d-4da0-96ee-c8aad66d6dc8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.540425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.541576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.542017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.542461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] PATH_INFO: `/v3/system/users/affaec817b154519bd0daa4f9d2b6924/roles/ecf2040a2471456090a7677fc8bf172a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.544705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=affaec817b154519bd0daa4f9d2b6924, role_id=ecf2040a2471456090a7677fc8bf172a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.546741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.560373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 173/332] 10.222.0.46 () {58 vars in 1334 bytes} [Mon May 23 15:14:07 2022] PUT /identity/v3/system/users/affaec817b154519bd0daa4f9d2b6924/roles/ecf2040a2471456090a7677fc8bf172a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:14:07.571304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.572305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.572595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.573036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] PATH_INFO: `/v3/users/f9ead2aa7b2845018a16abb6826a428f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.574472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] RBAC: Authorizing `identity:get_user(user_id=f9ead2aa7b2845018a16abb6826a428f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.576360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d55e1-571f-4de0-8c58-2c1cac0c690d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.579620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 160/333] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:07 2022] GET /identity/v3/users/f9ead2aa7b2845018a16abb6826a428f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:07.586155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:07.708509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253122-6f4c-44bd-b31d-19403e7fcfbe None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:07.745787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:07.751879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:07.752696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:07.752999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:07.753530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:07.754577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] RBAC: Adding query filter params (role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, user.id=f9ead2aa7b2845018a16abb6826a428f, scope.system=all) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:07.754964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:07.757790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e945a8-5c75-493a-ac9d-ac8e894e9fdd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:07.779490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 174/334] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 15:14:07 2022] GET /identity/v3/role_assignments?user.id=f9ead2aa7b2845018a16abb6826a428f&scope.system=all&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:09.506428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5726d1-f07c-48c0-a533-91a48e084bc6 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:09.506979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5726d1-f07c-48c0-a533-91a48e084bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:09.507251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5726d1-f07c-48c0-a533-91a48e084bc6 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:09.509034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 161/335] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:09.517362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:09.517856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:09.518143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:09.536493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:09.538288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:09.626252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 175/336] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:09.661590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5726d1-f07c-48c0-a533-91a48e084bc6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:09.779676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:09.791544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5726d1-f07c-48c0-a533-91a48e084bc6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:09.842844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:09.843698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:09.843985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:09.844261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:09.855743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:09.865838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:09.866746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:09.867593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:09.868203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 162/337] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:09.875459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.011846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b4c4d-6a89-4da9-9a84-9c1fcda27ab3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:10.037098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:10.054784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:10.055495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.055786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.056070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.056834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:10.057145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:10.058543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d7f9c-e7b1-4822-a11f-0758c12a5698 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:10.071047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 176/338] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:10.076740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.235353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e279beb-9ea4-44fd-99b6-cb68371d065f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:10.279594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:10.280265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.280554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.280832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.307964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:10.357019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d9f4-17ed-4498-a474-cec0a06e9d61 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.357366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d9f4-17ed-4498-a474-cec0a06e9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.357588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150d9f4-17ed-4498-a474-cec0a06e9d61 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.359267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 177/339] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:10.364146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:10.368784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b18d-21c4-4e74-a3ef-ca5f89a4bbff None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.368938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:10.369134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b18d-21c4-4e74-a3ef-ca5f89a4bbff None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.369362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205b18d-21c4-4e74-a3ef-ca5f89a4bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.405560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2205b18d-21c4-4e74-a3ef-ca5f89a4bbff None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:10.406766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2205b18d-21c4-4e74-a3ef-ca5f89a4bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:10.505912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 178/340] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:10.508581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d4ee-d833-422a-a032-39232b825eb7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.509087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d4ee-d833-422a-a032-39232b825eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.509558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d4ee-d833-422a-a032-39232b825eb7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.511111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 179/341] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:10.516124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 163/342] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:10.518041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.518821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.519303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.523415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.544473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:10.546020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:10.581145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:10.636290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1780f8-f50d-45fd-815a-aa0651f86191 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:10.651259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 180/343] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:10.652486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.673968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:10.674835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.675123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.675981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.677223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:10.678967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:10.681025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 164/344] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:10.686749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.735228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:10.803762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efd4d1-83fe-495a-9472-dbcc773d27c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:10.842621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ac406-c531-4ca5-97ba-4c33a82e111e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:10.845214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:10.846241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.846672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.847087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.851705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:10.856593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:10.858243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:10.860367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 165/345] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:10.862625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:10.898065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:10.899119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:10.899622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:10.900044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:10.914143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:10.922650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:10.923757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:10.924784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:10.927245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 181/346] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:10.928969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.056451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e72a9-67f5-4591-80c7-6ce8d066afb8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.058484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:11.091573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ff6f3-3a1b-4d8b-981c-cbd2d8c838bb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.125589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.126189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.126498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.126761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.127643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=2f523bbc54e641faab62cb271e8bfe62) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:11.127954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:11.129666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:11.140489 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.141578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.142011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.142429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.143928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 182/347] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:11.144923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.160029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:11.178589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:11.179887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:11.180921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:11.188391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 166/348] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:11.194886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.275884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:11.310525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ce411-4b55-4cc2-a8fc-65e495852422 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.329592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4080b99-cd0d-4d91-a6e3-78264b893317 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.363442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.364579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.365089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.366122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.367134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:11.367709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:11.369318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08387494-2bbc-4878-a189-299f4d8bb24f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:11.379687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 183/349] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:11.381680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83f01-5515-42f2-946c-a8d42e77baee None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.382185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83f01-5515-42f2-946c-a8d42e77baee None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.382691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83f01-5515-42f2-946c-a8d42e77baee None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.384648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 184/350] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:11.385629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83f01-5515-42f2-946c-a8d42e77baee None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.412267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.413925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.414147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.414397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.415206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:11.415543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:11.417023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15697584-f748-4042-a7f3-5cfb50ceac6a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:11.423809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:11.439139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 167/351] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:11.445392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.445691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.445954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.480463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:11.481777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:11.516977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83f01-5515-42f2-946c-a8d42e77baee None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.594279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.595085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.595255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.595599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.624554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 168/352] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:11.626069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.729521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:11.749697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:11.751612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:11.785942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6441a-9eea-4ffb-898d-c132d3ab212f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:11.788954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:11.831091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:11.831898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:11.832187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:11.832463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:11.880894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 185/353] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:11.881851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:11.932174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:11.934145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66922016-8c1d-4f67-af0c-d64a7c7bd917 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:11.977927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.038092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1346d62-b5b6-4b6e-ae98-688f341c5d43 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.067463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 169/354] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:12.069343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9a09-94d9-4939-9b96-790d5e52d23e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.069736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9a09-94d9-4939-9b96-790d5e52d23e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.070015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c9a09-94d9-4939-9b96-790d5e52d23e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.071533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 170/355] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:12.073209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.076683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9a09-94d9-4939-9b96-790d5e52d23e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.085665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.087150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.087494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.087783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.102681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0f498f7e-b7c0-4406-a010-21d91d60a4d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:12.110534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:12.111477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:12.112695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 186/356] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:12.113371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65a94-5c6d-4a66-9bb7-ee303dbd2fe1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.113371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65a94-5c6d-4a66-9bb7-ee303dbd2fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.113753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb65a94-5c6d-4a66-9bb7-ee303dbd2fe1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.115576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 187/357] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:12.117403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.117906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.118395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.144386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:12.147565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:12.229864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c9a09-94d9-4939-9b96-790d5e52d23e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.242000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 188/358] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:12.242813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.277121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.277989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.278276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.278553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.279946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.282210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.284948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 171/359] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.285989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.290435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.382853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c69613-7804-46b9-a8a6-6d93a695e81b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.403158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.417105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bb2be-903c-4667-8034-aa3036117a49 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.426649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.427683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.427962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.428429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.429883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.431338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4734d8-1935-4e3b-8443-1f2018d311ad None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.433337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 189/360] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.434514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.434806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.435201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.456956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:12.458272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:12.463264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.463974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.464264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.466380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.466380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:12.466380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.467198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.477440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 172/361] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.478284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.546294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 190/362] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:12.546950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.560545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.609354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6cb9-3b0b-41c7-a98c-68b8c2f56dd5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.651233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.652082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.652367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.653305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.665255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:12.673799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:12.674725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:12.675580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:12.676195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 173/363] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:12.677003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.684315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08558ca-a6c9-4501-9e74-31071d24cf8b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.711057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.737123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.737996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.738280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.738630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.739830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.742309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.744049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 191/364] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.744812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.807983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50093ad9-0603-4a83-81dc-baf5c0ca976b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.836267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:12.856289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.857195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.857459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.857746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.859858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.861308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.863130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 174/365] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.864394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.883069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d50bc-ea5a-4591-b36f-d3d26053d22b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:12.928503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:12.929830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:12.930122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:12.930402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] PATH_INFO: `/v3/users/affaec817b154519bd0daa4f9d2b6924` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:12.931834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] RBAC: Authorizing `identity:get_user(user_id=affaec817b154519bd0daa4f9d2b6924)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:12.933557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:12.936304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 192/366] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/users/affaec817b154519bd0daa4f9d2b6924 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:12.937088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:12.994164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bfc7-5c3c-4c62-b39c-14fb5ff0d84f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.010026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:13.044484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.045654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.045998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.046273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.058657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:13.067079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:13.068035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:13.069075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:13.069690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03e31-5cb7-4de3-86fe-dcd7a90c2b24 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.069762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 175/367] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:13.069762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.113286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.113969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.114259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.114541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.115298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:13.116347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:13.117787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:13.127460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 193/368] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:13.128594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.147892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:13.230735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4c625-91e3-405e-91c0-7a9c118fcada None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.256711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3596a-7bf6-4b5d-88e9-c882d83a001d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.274750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:13.288823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.288823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.289216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.289216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.290906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=9ebb568211b349f1a08083e14d85f98d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:13.290906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:13.294030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:13.300141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 176/369] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:13.302252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.311047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.311690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.311979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.312264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.319394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=2f523bbc54e641faab62cb271e8bfe62) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:13.319394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:13.319394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:13.321958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 194/370] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:13.323636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.478962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f4d2e-ba23-4e7e-84cd-615f64110397 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.555740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db5c4b-229d-480f-8837-d6a2032b5f0d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.560950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.561711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.561943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.563023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:13.563334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:13.564837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:13.581427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 195/371] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:13.582370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.586231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:13.616750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0651-7383-429c-8986-423998814a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.616750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0651-7383-429c-8986-423998814a46 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.617111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0651-7383-429c-8986-423998814a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.617111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0651-7383-429c-8986-423998814a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.617986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0651-7383-429c-8986-423998814a46 None admin] RBAC: Adding query filter params (role.id=ecf2040a2471456090a7677fc8bf172a, user.id=affaec817b154519bd0daa4f9d2b6924, scope.system=all) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:13.618304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0651-7383-429c-8986-423998814a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:13.619829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0651-7383-429c-8986-423998814a46 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:13.637958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 177/372] 10.222.0.46 () {56 vars in 1308 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/role_assignments?user.id=affaec817b154519bd0daa4f9d2b6924&scope.system=all&role.id=ecf2040a2471456090a7677fc8bf172a => generated 510 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:13.639314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0651-7383-429c-8986-423998814a46 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:13.659704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:13.787220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a90ba-373e-4e4a-89a6-c49357238057 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.830842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0651-7383-429c-8986-423998814a46 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:13.884480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.885154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.885438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.885715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.899221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:13.899924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:13.900209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:13.900483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:13.998265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.015298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.017430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.028515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.030009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e24b7-c57e-4935-9ae0-33d36b33c489 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.089414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.159552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 196/373] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:14.159951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 178/374] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:14.160923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905725b-328d-4e44-a3f5-1402fe562b79 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.161215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905725b-328d-4e44-a3f5-1402fe562b79 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.161494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905725b-328d-4e44-a3f5-1402fe562b79 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.164380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 197/375] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:14.165943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.168243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905725b-328d-4e44-a3f5-1402fe562b79 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.267877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.278780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905725b-328d-4e44-a3f5-1402fe562b79 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.281148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69990586-2280-4109-9e69-3ce5f0c0117b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.318706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.320434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.320720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.320995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] PATH_INFO: `/v3/projects/a4ecdc8eee23475faa49db60f90175a3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.321825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.322199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ecdc8eee23475faa49db60f90175a3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.323142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.323660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.323761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0956d-524e-4a41-a336-cc8477a529d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.324220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.325403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 198/376] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/projects/a4ecdc8eee23475faa49db60f90175a3 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:14.326152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.326688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.326976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.327254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.328486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.331245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 179/377] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:14.332267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.347702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:14.348819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:14.353402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.434986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 199/378] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:14.436110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.467957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699839e6-13d7-4ad2-a2b6-a379d035df96 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.523795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.525029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.525509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.526002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] PATH_INFO: `/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.531543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] RBAC: Authorizing `identity:get_group(group_id=a5a2341d41ba4ef3bd83e8b577d81ba6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.533268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.535118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 180/379] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:14.536101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.546740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.580894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b2c0e-c636-4937-8945-903ec0167e23 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.617728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.618553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.618837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.619114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.620331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.621886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.623524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 200/380] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:14.624391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.634419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.650129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755fc3a-1de5-4a69-969b-130a9d479e7d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.686777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.687994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.688505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.688999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.700938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:14.708983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:14.709923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:14.710811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:14.713222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 181/381] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:14.714209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.785242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc8880-92a4-42b8-b325-fdcc23c70c89 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.824830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.844435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:14.845108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:14.845455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:14.846338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:14.846826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] RBAC: Adding query filter params (group.id=a5a2341d41ba4ef3bd83e8b577d81ba6, role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=a4ecdc8eee23475faa49db60f90175a3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:14.847142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:14.849556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:14.860754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 201/382] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/role_assignments?group.id=a5a2341d41ba4ef3bd83e8b577d81ba6&scope.project.id=a4ecdc8eee23475faa49db60f90175a3&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:14.860754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:14.901829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1668-02fa-425e-ae76-a5a799934e03 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:14.946050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:14.985484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778e78a-cd30-4d2c-a973-227b7db18f5f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:15.026978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:15.027759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:15.028178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:15.028534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:15.029306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:15.029493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:15.029615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:15.030576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:15.031000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:15.031265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:15.031748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:15.032814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=9ebb568211b349f1a08083e14d85f98d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:15.033325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:15.034982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:15.046490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 202/383] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:15.048497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 182/384] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:14 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 260 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:15.052261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:15.193744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467b004-ab2f-4c3b-be68-fd84c936f464 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:15.229322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:15.236436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:15.238106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:15.238292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:15.238558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:15.239987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:15.243387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:15.244537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 203/385] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:15 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:15.259528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:15.415933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638ac3e-ec61-4e49-a39d-6be43c609ea5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:15.454902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:15.463127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:15.464305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:15.464756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:15.465228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:15.466891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:15.468569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f333-b37f-4ffe-b519-95dde7e2908f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:15.471006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 183/386] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:15 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:15.477547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:15.606440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d283d8-b0ee-47f0-ba66-3668943ef467 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:15.667021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:15.667941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:15.668224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:15.668500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/groups/cd733d8c47754ebdadd306d69b653bbc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:15.676702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, group_id=cd733d8c47754ebdadd306d69b653bbc, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:15.678155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce7ab-cd6e-4b7d-9315-14fb4f1a1abf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:15.703634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 204/387] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 15:14:15 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/groups/cd733d8c47754ebdadd306d69b653bbc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:16.262714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a92b0-20f6-40c1-881f-afe41b80c25d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.262714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a92b0-20f6-40c1-881f-afe41b80c25d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.262714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a92b0-20f6-40c1-881f-afe41b80c25d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.263891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 184/388] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:16.268047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3a41-44a0-484f-a36e-1dbe38eebb43 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.268833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3a41-44a0-484f-a36e-1dbe38eebb43 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.269330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e3a41-44a0-484f-a36e-1dbe38eebb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.292416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d24e3a41-44a0-484f-a36e-1dbe38eebb43 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:16.293958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d24e3a41-44a0-484f-a36e-1dbe38eebb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:16.355421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:16.368646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 205/389] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:16.402388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a92b0-20f6-40c1-881f-afe41b80c25d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:16.453174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169d1c-cea2-4b5b-9db4-236ac1b7cb0c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.453493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169d1c-cea2-4b5b-9db4-236ac1b7cb0c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.453739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169d1c-cea2-4b5b-9db4-236ac1b7cb0c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.455288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 206/390] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:16.466301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.466713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.467121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.503923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:16.507973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:16.607837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a92b0-20f6-40c1-881f-afe41b80c25d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:16.649782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:16.650157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 207/391] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:16.650593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.650874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.651146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.662470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:16.671324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:16.672250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:16.673217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 185/392] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:16.678265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:16.685724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:16.802791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:16.854788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaea0ee-83d0-486d-889a-5b2fbfa8513b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:16.882243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91cc04-e191-4e2c-9920-cc3b5c9bc692 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:16.903608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:16.936521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:16.937549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.938054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.938541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:16.940688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:16.941218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:16.943810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:16.959764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 208/393] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:16.966351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:16.967248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:16.968331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:16.968809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:16.969504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.002435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:17.012862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:17.013771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:17.014593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 186/394] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:17.017932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.110216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bace32-8da9-4248-9120-d4a0e75c67ad None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.154587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.155391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.155685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.155964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.160118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.161596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.163466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 209/395] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:16 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:17.169053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.169288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbceb-6222-4f3c-8eab-160cd039f2ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.191845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:17.206560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.207269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.207586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.207868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.208627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:17.208942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.210430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.224314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 187/396] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:17.226232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.281093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:17.338541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b619-e0bd-4f04-97b9-e9a4c92bd587 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.376132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.377081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.377374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.377655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.379812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.381484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.388771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 188/397] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:17 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:17.391071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.392395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f52cab-1631-44a0-b8fa-8ad39360c9c2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.471994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:17.492432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.493712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.494203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.494672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.500102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.501813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.504132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 210/398] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:17 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:17.509560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.516657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f25b10-4956-41e8-bf0d-6e56e00d1d31 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.553447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.554795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.554999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.555253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.563464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.563464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.564592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 189/399] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:17 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:17.565848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:17.665696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd2f5c-8f56-494e-a016-411f5fca0613 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.689414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:17.718121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.719128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.719462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.719750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62/groups/cd733d8c47754ebdadd306d69b653bbc/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.720098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64086-fc76-4ed7-b18d-1a7c3e47c484 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:17.722318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] RBAC: Authorizing `identity:create_grant(project_id=2f523bbc54e641faab62cb271e8bfe62, group_id=cd733d8c47754ebdadd306d69b653bbc, role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.724572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e9a61-c5e1-46de-971f-935fd6eccdde None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.739305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:17.742888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 211/400] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 15:14:17 2022] PUT /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62/groups/cd733d8c47754ebdadd306d69b653bbc/roles/e44bbee3e1df41568b635760aa1e44dd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:17.744842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-e113-4380-aca0-b54bcc8fe189 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.745770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-e113-4380-aca0-b54bcc8fe189 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.746065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490dfa6-e113-4380-aca0-b54bcc8fe189 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.748166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 212/401] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:17.754841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5dd7-d403-498a-a329-4c58574912f3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.755460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5dd7-d403-498a-a329-4c58574912f3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.755837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e5dd7-d403-498a-a329-4c58574912f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.767396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:17.768484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:17.768882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:17.769303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/groups/cd733d8c47754ebdadd306d69b653bbc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:17.773103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, group_id=cd733d8c47754ebdadd306d69b653bbc, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:17.774829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:17.777498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-713e5dd7-d403-498a-a329-4c58574912f3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:17.779380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-713e5dd7-d403-498a-a329-4c58574912f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:17.800842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 190/402] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 15:14:17 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/groups/cd733d8c47754ebdadd306d69b653bbc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:14:17.901159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 213/403] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:17.924505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.029300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c29f-05c9-4017-accb-3531188eeaf5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.033740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c29f-05c9-4017-accb-3531188eeaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.033740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c29f-05c9-4017-accb-3531188eeaf5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.033740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 214/404] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:18.038951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.039265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.039563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.056417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f34a-7102-4a49-a2d4-6874f4731f4d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.071734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:18.073157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:18.105412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.107022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.107355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.107951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.123602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:18.135216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:18.137415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:18.139275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 191/405] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:18.147405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.161803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 215/406] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:18.182902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.185915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.234106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.259151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f138-0944-443d-90bb-395c4f4e8594 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.296264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.296264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.296757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.296906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.297570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:18.297882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.299313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.302080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7588-5ffe-4016-b498-d5e95a6956da None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.309004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 192/407] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:18.314708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.340165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.341257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.341547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.341831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.353365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:18.366757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:18.368805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:18.369791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 216/408] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:18.376427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.430585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.436363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a5677-26c3-4b9a-8ed3-9609ea935a48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.481228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.482754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.483043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.483437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] PATH_INFO: `/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.485072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] RBAC: Authorizing `identity:get_group(group_id=a5a2341d41ba4ef3bd83e8b577d81ba6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.487198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.489975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 193/409] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:18.500782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.547866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28576207-61f8-4313-84ee-9cacb6e8cad0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.552301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.626796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.627501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.627790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.628123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.628891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:18.629201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.630576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.653934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 217/410] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:18.659343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.673227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a08803-5f00-4031-aaa7-e6b8b6f73a6c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.709920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.711391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.711670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.711946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] PATH_INFO: `/v3/projects/a4ecdc8eee23475faa49db60f90175a3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.713155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ecdc8eee23475faa49db60f90175a3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.714620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adfbdf-7748-410b-90a0-801f0d4cf187 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.716636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 194/411] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/projects/a4ecdc8eee23475faa49db60f90175a3 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:18.717823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5513b9-ca34-4a1d-a67a-fc94449e2b62 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.718112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5513b9-ca34-4a1d-a67a-fc94449e2b62 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.718389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5513b9-ca34-4a1d-a67a-fc94449e2b62 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.724940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 195/412] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:18.725857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5513b9-ca34-4a1d-a67a-fc94449e2b62 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.767206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.786821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e3e0-205d-4272-9e69-391dea64450f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.826954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.827858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.828143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.828551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.829776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.831276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ad2a3-8d95-474b-9754-efee5195c435 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.833314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 218/413] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:18.834620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.834933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.835980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.853341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5513b9-ca34-4a1d-a67a-fc94449e2b62 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:18.853556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:18.854729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:18.878555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:18.896380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:18.898248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:18.898750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:18.899302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] PATH_INFO: `/v3/projects/a4ecdc8eee23475faa49db60f90175a3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:18.901722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=a4ecdc8eee23475faa49db60f90175a3, group_id=a5a2341d41ba4ef3bd83e8b577d81ba6, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:18.903574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:18.927735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 196/414] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 15:14:18 2022] PUT /identity/v3/projects/a4ecdc8eee23475faa49db60f90175a3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:18.927735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:18.942841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 219/415] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:18.966866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:19.116424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:19.137790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192de61f-e638-46a9-bba7-af6b838f6e5f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:19.160096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa928b-ec4f-4e41-b562-0d4a8cd43133 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:19.178984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:19.180204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:19.180726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:19.181204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:19.182731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:19.184658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:19.186701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 197/416] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:19.192229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:19.203106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:19.203948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:19.204230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:19.204500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:19.225069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:19.237323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:19.238248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:19.239052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:19.240887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 220/417] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:19.249066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:19.292658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:19.324511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83485-9b77-4bda-9dac-39159bd195cb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:19.362655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:19.363938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:19.364461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:19.364955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d/groups/cd733d8c47754ebdadd306d69b653bbc/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:19.368061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] RBAC: Authorizing `identity:create_grant(project_id=9ebb568211b349f1a08083e14d85f98d, group_id=cd733d8c47754ebdadd306d69b653bbc, role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:19.370267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:19.391040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 198/418] 10.222.0.46 () {58 vars in 1442 bytes} [Mon May 23 15:14:19 2022] PUT /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d/groups/cd733d8c47754ebdadd306d69b653bbc/roles/e44bbee3e1df41568b635760aa1e44dd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:19.436742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac36d8-3d38-4818-9aca-414e27f581d5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:19.477165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:19.478239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:19.478754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:19.479231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:19.480239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:19.480783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:19.482407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:19.492885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 221/419] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:19.498852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:19.527187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:19.637107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342470-c5da-4586-a09d-0c0c93b2937e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:19.680515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:19.681556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:19.682046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:19.682536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:19.755492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:19.757967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:19.782457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:19.882571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 199/420] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:19.888278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:20.004864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:20.032614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5776-bdd5-4ab7-9d8b-d0eeaa19a886 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:20.068654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:20.069613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.069910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.070190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.071445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:20.072896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:20.074918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 222/421] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:19 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:20.080413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:20.199172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740656d-7fa3-4e68-8f36-af28ba05e000 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:20.234254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:20.252437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:20.253302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.253638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.253922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.260091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:20.261586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3010782-e5ff-4d9a-af47-cad609ddaa52 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:20.263271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 200/422] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:20 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:20.269179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:20.384830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecc8f5-5767-4fd7-9dce-0d55de9c56a7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:20.422513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:20.423181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.423501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.423784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.424626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=2f523bbc54e641faab62cb271e8bfe62) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:20.424944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:20.426394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf35ce-8331-433e-98c0-38ca96b27807 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:20.433594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 223/423] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:20 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:20.574487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92314-4feb-415a-97af-ebae15651590 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.575161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92314-4feb-415a-97af-ebae15651590 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.575161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92314-4feb-415a-97af-ebae15651590 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.576718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 201/424] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:20.582151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd486a6-35bc-481d-a14a-c2a95f68bc53 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.582743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd486a6-35bc-481d-a14a-c2a95f68bc53 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.582743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd486a6-35bc-481d-a14a-c2a95f68bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.608648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1dd486a6-35bc-481d-a14a-c2a95f68bc53 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:20.609892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1dd486a6-35bc-481d-a14a-c2a95f68bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:20.618614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:20.699805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 224/425] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:20.727164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92314-4feb-415a-97af-ebae15651590 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:20.775243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6932a-73d1-4704-ba16-5f6af203cff3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.775576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6932a-73d1-4704-ba16-5f6af203cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.775843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6932a-73d1-4704-ba16-5f6af203cff3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.777501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 225/426] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:20.782334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.782619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.782902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.799715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:20.800910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:20.857528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92314-4feb-415a-97af-ebae15651590 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:20.886912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 226/427] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:20.902445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:20.903253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:20.903582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:20.903914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:20.911986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:20.917192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:20.925367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:20.926277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 23 15:14:20.927073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:20.928476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 202/428] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:20.933618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.003771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.004294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.044122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af45ca6-07a8-4add-87fb-673554ef14e3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.076097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1f79d-a02c-428b-8be2-3377c1c8d5a1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.089146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.090102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.090395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.090926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.107134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:21.118812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:21.120977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:21.122861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 227/429] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:21.127260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.132249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.132937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.133271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.133554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.134319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] RBAC: Adding query filter params (name=member) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:21.134628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.136165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.146314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 203/430] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:14:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:21.151920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.269558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310e76e-5393-4db0-9ce2-603ed8edf9ac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.301551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e76c5-e02a-4896-a64e-dc84ff76f93f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.310280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.317871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.318859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.319317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.320729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.321825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.324273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:21.324947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.327269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.340049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 228/431] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:21.345863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.351392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.352312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.352806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.353285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.427307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.429704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.458838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5554a-6b42-4fc6-ab9c-20713dd73f84 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.497743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.498685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.498995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.499279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.546875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 204/432] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:21.552613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.570361 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.582352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.593448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.595198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.667723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7eaf5-28e9-4a55-be3f-edb5cd79bb7f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.705050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 229/433] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:14:21.705233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.706137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.706414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.706688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.707991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.709766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.710355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.716775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 205/434] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:21.717684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.806336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.813185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:21.826341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059232-1952-483e-bbc0-9b32c63567a8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.827982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330d7c-5fa6-49ab-9bcf-6a49b0a608a7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:21.865228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.865999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.866280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.867315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.868617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.870080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7991e-0397-464f-a6f8-32c15938171c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.870929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:21.871743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 206/435] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:21.876662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.876662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.876662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] PATH_INFO: `/v3/projects/2f523bbc54e641faab62cb271e8bfe62` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.876866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d6f3-582d-48d6-880e-9b1be4158739 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.876866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d6f3-582d-48d6-880e-9b1be4158739 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.876866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5d6f3-582d-48d6-880e-9b1be4158739 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.876866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 207/436] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:21.877273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] RBAC: Authorizing `identity:get_project(project_id=2f523bbc54e641faab62cb271e8bfe62)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:21.878816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15885e6-a027-4210-8fe8-8911ec9f900b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:21.879331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5d6f3-582d-48d6-880e-9b1be4158739 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:21.880683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 230/437] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/projects/2f523bbc54e641faab62cb271e8bfe62 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:21.881900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:21.882286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:21.882572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:21.899174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:21.900394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:21.971650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 231/438] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:21.972867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.007668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5d6f3-582d-48d6-880e-9b1be4158739 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.046255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.046954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.047235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.047577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.048430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=b5590f1e1caf40fa8b92fbc8e9b2c173, scope.project.id=9ebb568211b349f1a08083e14d85f98d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:22.048738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.050439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.063602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 208/439] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:22.063602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.085089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.088189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.099203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ae2ab-ffeb-46e3-a59f-41fc102c468d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.145726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.146635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.146981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.147331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.149115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.150667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.157582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 232/440] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:21 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:22.158621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.222573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f037d6-12b6-4200-ab97-bfce28a287b1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.274710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.276370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.276662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.277284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.286123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35581fdc-3b80-4901-bccb-908325737447 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.292288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8c74e5f8-b769-487a-90b9-850ea2cf204a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:22.300039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:22.300944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:22.301747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 209/441] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:22.303009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e873-5317-41d8-b44f-ee05dde1c3e3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.303216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e873-5317-41d8-b44f-ee05dde1c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.303525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e873-5317-41d8-b44f-ee05dde1c3e3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.305359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 210/442] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:22.307996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e873-5317-41d8-b44f-ee05dde1c3e3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.332786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.333455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.333734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.334062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.334996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=2f523bbc54e641faab62cb271e8bfe62) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:22.335348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.337034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0e0a0-da4e-4995-81c5-be51ae3c0529 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.343268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 233/443] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=2f523bbc54e641faab62cb271e8bfe62&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:22.344510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.344795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.345067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.362249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:22.363557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:22.385602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.390685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.431104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e873-5317-41d8-b44f-ee05dde1c3e3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.446111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 234/444] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:22.470499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.480205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.480882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.481168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.481439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.482334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:22.482641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.484102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.494328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 211/445] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:22.499986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.597184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f97841-5ec8-4694-9278-a3b605095dfd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.624845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8fc8e-b76c-41a9-b51d-e59c28f126c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.644885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.646525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.646525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.646525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.665975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:22.670098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.670098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.670098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.670098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.672585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:22.675397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:22.676283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:22.677289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 235/446] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:22.682474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.701996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.759834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.761475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.808560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe693c-04a5-43ee-b167-e9513eaa20d7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.848227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:22.849265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:22.849798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:22.850235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:22.851104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:22.851577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:22.852985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:22.862850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 236/447] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:22.869256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.882312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 212/448] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:14:22.888115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:22.924636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.950124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:22.975211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874e94e-276d-46f1-8758-80ec3daec8f6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:22.994576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bec9c-7c9c-481d-a1f1-5244a99a61b6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.009261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.009914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.010201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.010481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.028869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.029716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.029992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.030264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] PATH_INFO: `/v3/projects/a4ecdc8eee23475faa49db60f90175a3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.031469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ecdc8eee23475faa49db60f90175a3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.032912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.034595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 213/449] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/projects/a4ecdc8eee23475faa49db60f90175a3 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:23.040437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:23.078194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.079669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.137789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f170be-8942-467d-a279-dab3d498fea4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.139428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:23.153363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:23.174529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.175399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.175688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.175989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] PATH_INFO: `/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.176980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 237/450] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 23 15:14:23.179617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] RBAC: Authorizing `identity:get_group(group_id=a5a2341d41ba4ef3bd83e8b577d81ba6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.181076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.187198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 214/451] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:23 2022] GET /identity/v3/groups/a5a2341d41ba4ef3bd83e8b577d81ba6 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:23.187338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:23.188117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:23.282886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe412d0-7970-411d-89bd-d11a8cd97ffb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.303642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9864d-a5ad-4f25-959b-ccdc1c02a973 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.320893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.321760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.322044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.322322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] PATH_INFO: `/v3/projects/9ebb568211b349f1a08083e14d85f98d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.323561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] RBAC: Authorizing `identity:get_project(project_id=9ebb568211b349f1a08083e14d85f98d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.325022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.326699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 238/452] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:14:23 2022] GET /identity/v3/projects/9ebb568211b349f1a08083e14d85f98d => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:23.332064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:23.339219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.339904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.340192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.340471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.341549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] RBAC: Adding query filter params (group.id=a5a2341d41ba4ef3bd83e8b577d81ba6, role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=a4ecdc8eee23475faa49db60f90175a3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:23.341872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.343312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.349337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 215/453] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:23 2022] GET /identity/v3/role_assignments?group.id=a5a2341d41ba4ef3bd83e8b577d81ba6&scope.project.id=a4ecdc8eee23475faa49db60f90175a3&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:23.380448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:23.442240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f95435-7bd5-4bf3-bd3f-7db06c0776bd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.480748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.481629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.481907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.482180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] PATH_INFO: `/v3/groups/cd733d8c47754ebdadd306d69b653bbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.483434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] RBAC: Authorizing `identity:get_group(group_id=cd733d8c47754ebdadd306d69b653bbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.484892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f59fb-6859-49a0-b3ee-fae1780b2cd2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.486569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 239/454] 10.222.0.46 () {56 vars in 1180 bytes} [Mon May 23 15:14:23 2022] GET /identity/v3/groups/cd733d8c47754ebdadd306d69b653bbc => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:23.492774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:23.529658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:23.600307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76598904-5fc5-4180-81de-06e7f3742c64 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:23.633540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:23.634171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:23.634447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:23.634712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:23.635584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] RBAC: Adding query filter params (group.id=cd733d8c47754ebdadd306d69b653bbc, role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=9ebb568211b349f1a08083e14d85f98d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:23.635890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:23.637320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d1003-91ac-4977-958c-e68b7addfcad None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:23.643017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 216/455] 10.222.0.46 () {56 vars in 1376 bytes} [Mon May 23 15:14:23 2022] GET /identity/v3/role_assignments?group.id=cd733d8c47754ebdadd306d69b653bbc&scope.project.id=9ebb568211b349f1a08083e14d85f98d&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:26.465426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cb147-6822-4db6-ac07-9eb01e83786c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.465946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cb147-6822-4db6-ac07-9eb01e83786c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.466022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cb147-6822-4db6-ac07-9eb01e83786c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.467904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 240/456] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:26.485253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.485858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.485858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.512433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:26.513663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:26.558186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24963-e126-434a-a36e-33ac14050001 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.558471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24963-e126-434a-a36e-33ac14050001 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.558916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24963-e126-434a-a36e-33ac14050001 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.560787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 241/457] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:26.566099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.566612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.567154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.584387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:26.586434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:26.612074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 217/458] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:26.670438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:26.684768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 242/459] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:26.714422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:26.739188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:26.784441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:26.841558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40825bb9-147c-4c4c-becb-5e87dbe49218 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:26.858026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806a351-cc80-44d3-8d3e-a0d53194b1a6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:26.892838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:26.894242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.894819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.895374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.895698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:26.896504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.896780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.897061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.909204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:26.910192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:26.910660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:26.912605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-05d0a1cc-618a-4123-87f0-180194cbaf56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:26.929048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:26.930503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:26.931395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:26.931395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:26.931395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:26.931395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:26.932268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 243/460] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:26.933957 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1928d-8ca3-4883-a515-3c53abd08265 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.934248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1928d-8ca3-4883-a515-3c53abd08265 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.934524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1928d-8ca3-4883-a515-3c53abd08265 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.937008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 244/461] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:26.942108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:26.942108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:26.942108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:26.942561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:26.943354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:26.944292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:26.944292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:26.944292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:26.944292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:26.944999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 218/462] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:26.945900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:26.963381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:26.964590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:27.041589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.042700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 245/463] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:27.043846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.066931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644473d-e2b7-4b3c-8007-4e58572acd54 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.091232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.107436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.108476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.108956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.109426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.110370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:27.110884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.112491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.130490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 219/464] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:27.136501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.174779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d313e-c623-4a3f-ab0a-835436546f6d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.210407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.212009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.212971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.212971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.213287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:27.213596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.214983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.227681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 246/465] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:27.228636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.246470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e176fa-6940-4d83-9eab-309f2cfa3161 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.282698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.283517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.283800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.284068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.294033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.296032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.297694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:27.316835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:27.317723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:27.318568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:27.318568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:27.318568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:27.318568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:27.318568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 220/466] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:27.318837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.326661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.344615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e8326-6dca-4f42-94cc-96b4225def28 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.381043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.382030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.382463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.382820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.383916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.385479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270fbbe-e4c3-4d62-a66a-815a34198535 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.409085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 247/467] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:27 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:27.410749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108ac4-c130-40ed-bc7c-64cbea1123b8 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.411220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108ac4-c130-40ed-bc7c-64cbea1123b8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.411528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108ac4-c130-40ed-bc7c-64cbea1123b8 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.412985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 248/468] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:27.413613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108ac4-c130-40ed-bc7c-64cbea1123b8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.438770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685fc3c-d12b-4ec9-ab89-6193ebd10d17 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.483102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.486026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.486625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.486625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.487317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.488864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78accd-96d7-4e3e-87f5-27c3e2b33fc6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.512953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 221/469] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:27 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:27.514423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.514719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.515008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.548140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:27.549736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:27.628960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108ac4-c130-40ed-bc7c-64cbea1123b8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.634129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.673000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 222/470] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:27.690016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.691091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.691603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.692107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.693129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:27.693650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.695933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.701396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.717936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:27.725273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 249/471] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:27.732345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.853514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60762bb-8218-4dce-9cea-b8885b4975c7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.868723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf3aa3-eec2-4d63-b9e9-dcacbf369eb5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:27.895128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.895946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.896261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.896497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.908728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.910204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.921982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:27.922984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:27.923492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:27.923986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:27.924890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:27.926505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa5116-fc4d-4976-99a5-0dc25836cb14 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:27.928856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:27.929700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:27.930594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:27.930594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:27.930594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:27.930594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:27.935238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 223/472] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:27.936550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:27.964452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 250/473] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:27 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:14:27.977379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:28.028677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a2b43-624d-4762-9368-d28f749d1b4b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.029037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a2b43-624d-4762-9368-d28f749d1b4b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.029254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a2b43-624d-4762-9368-d28f749d1b4b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.031006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 251/474] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:28.036720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.037006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.037295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.055584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:28.056833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:28.061292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae531-4e19-4cf8-bc54-10fb88871d1a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:28.109775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:28.110805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.111086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.111668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.112418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:28.112730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:28.114649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:28.127863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:28.130522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 224/475] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:28.133083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 252/476] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:28.136650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:28.159691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:28.261048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:28.269980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523e74-4b23-4deb-a2bf-844e7abf0db5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:28.275021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cff549-2a74-4d80-b2c7-70ba7fbd54e5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:28.308948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:28.309640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.309929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.310210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.310982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:28.312418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:28.318931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.sql.core [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:14:28.318931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:14:28.318931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [parameters: {'id': '466c7a49b3e84431b84e21325c9dcf17', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:14:28.318931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80364) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:14:28.320334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:28.321624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.321910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.322188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.322905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:28.324502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 23 15:14:28.338448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return ref.to_dict() May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:14:28.339732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application yield resource May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise self.value May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application session.commit() May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:14:28.340960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.flush() May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application compat.raise_( May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:14:28.342561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:14:28.344514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:14:28.346910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [parameters: {'id': '466c7a49b3e84431b84e21325c9dcf17', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:28.348839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 23 15:14:28.351728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.355237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 253/477] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 15:14:28 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:28.355237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:28.368302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 225/478] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:28 2022] POST /identity/v3/users => generated 249 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:28.443910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:28.508102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179b547-f65e-4a9d-99c9-0ea400dd9c56 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:28.546643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:28.547506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.547795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.548075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.560988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a9a49a6d-d212-4bc1-af08-16f70351a9b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:28.569295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:28.570222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 23 15:14:28.571228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:28.572187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 254/479] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:14:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:28.577686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:28.690934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda57a5-3559-42a2-9e6d-144dbf958245 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:28.726282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:28.727690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:28.727973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:28.728251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:28.729003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:28.729310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:28.730710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee58a-a207-43f4-8536-5c6c39a7f8a9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:28.739464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 226/480] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:30.330861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39c48-b94b-4a7a-9f6e-5620ca7da895 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.331426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39c48-b94b-4a7a-9f6e-5620ca7da895 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.331712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39c48-b94b-4a7a-9f6e-5620ca7da895 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.333363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 255/481] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:30.339181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93e89-274c-420b-a9f4-3cb9ed022cbe None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.339642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93e89-274c-420b-a9f4-3cb9ed022cbe None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.339956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d93e89-274c-420b-a9f4-3cb9ed022cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.358533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-00d93e89-274c-420b-a9f4-3cb9ed022cbe None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:30.359915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-00d93e89-274c-420b-a9f4-3cb9ed022cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:30.362077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:30.439268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 227/482] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:30.480222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d39c48-b94b-4a7a-9f6e-5620ca7da895 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:30.496952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ad4-b5d7-45d1-ad7e-fab633814f89 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.497238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ad4-b5d7-45d1-ad7e-fab633814f89 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.497527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6ad4-b5d7-45d1-ad7e-fab633814f89 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.499148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 228/483] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:30.506370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.506657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.506933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.534658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:30.535873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:30.657267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d39c48-b94b-4a7a-9f6e-5620ca7da895 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:30.668602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:30.669795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 229/484] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:30.704122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:30.713398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:30.714448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.714872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.715286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.734287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:30.750571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:30.751711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:30.752702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:30.760109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 256/485] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:30.761758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:30.799749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:30.859351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf8300-6e87-4cfb-967a-57fe207fb4fc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:30.922163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:30.922880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.923161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.923457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.938707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:30.948747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:30.949685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:30.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:30.951331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 230/486] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:30.951417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98a8d-c4ff-4338-abbb-ec140a59f9f6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:30.960508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:30.994157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:30.994856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:30.995143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:30.995451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:30.996229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:30.996540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:30.997961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.019484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 257/487] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:31.025288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.083166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.135756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb60dd-9767-44c4-bbcb-37075e6a7857 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.163119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.180599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.181206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.181492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.181766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.182517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:31.182828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.184264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.201213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 231/488] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:31.204194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5209dc-a047-4586-8222-e0ad0917a630 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.206462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.249963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.250792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.251076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.252130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.268448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.270252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-bc05fa66-fa4f-4238-91c2-6b797a8bdce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:31.291515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:31.294499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:31.296555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:31.296555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:31.296555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:31.296555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:31.301487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 258/489] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:31.301487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc31a9-5848-4c8b-a885-0af00ba87cde None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.301487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc31a9-5848-4c8b-a885-0af00ba87cde None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.301487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc31a9-5848-4c8b-a885-0af00ba87cde None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.301487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 259/490] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:31.302306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc31a9-5848-4c8b-a885-0af00ba87cde None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.327171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6303b1-e663-4958-a667-75c2fcacdd1e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.364407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.365204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.365488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.365763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.377963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.379473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c1a341a9-0ec7-4b8d-9730-e58dd777c5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:31.397525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:31.398564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:31.400691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:31.400691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:31.400691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:31.400691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:31.400691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 232/491] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:31.401006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b4fab-8512-411a-beee-174930516141 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.401006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b4fab-8512-411a-beee-174930516141 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.402092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b4fab-8512-411a-beee-174930516141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.419220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.421419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-066b4fab-8512-411a-beee-174930516141 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:31.422631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-066b4fab-8512-411a-beee-174930516141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:31.437950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc31a9-5848-4c8b-a885-0af00ba87cde None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.475479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.476270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.476568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.476930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.477284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.478102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:31.478102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.479979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.492167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 260/492] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:31.493117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.516697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 233/493] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:31.518056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba678a-747e-48a2-a9c1-810f364dfd74 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.518342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba678a-747e-48a2-a9c1-810f364dfd74 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.518620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba678a-747e-48a2-a9c1-810f364dfd74 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.520352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 234/494] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:31.523603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba678a-747e-48a2-a9c1-810f364dfd74 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.605064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621740e-9465-4b79-a4af-dcc6556fecc6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.627008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba678a-747e-48a2-a9c1-810f364dfd74 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.638600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.639271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.639583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.639865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.640590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:31.640898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.642289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd7adc-e6fd-480a-854b-e3202f3ca06d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.653720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 261/495] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:31.655010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffd5a-30cc-43ca-ad08-a571d3c7400e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.655302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffd5a-30cc-43ca-ad08-a571d3c7400e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.655613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffd5a-30cc-43ca-ad08-a571d3c7400e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.656836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 262/496] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:31.658161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.658350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.658669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.664321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.667497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.668292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.668580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.668858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.675421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:31.676134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.676616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:31.677606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:31.694977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:31.696456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:31.697366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 235/497] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:31.697953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.730499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.746670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 263/498] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:31.747564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.801427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be67d2-df41-4dbb-98d3-6323f26a79c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.836165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.837111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.837392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.837666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.847885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:31.853384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d291f-9714-4d3a-9e1a-65c0df89db92 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-69346d89-e861-40c7-83f5-6c491928bd52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:31.855754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:31.856797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:31.857598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 236/499] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:31.858283 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.858745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.858745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.875415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:31.876630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:31.888867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:31.889668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:31.889956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:31.890236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:31.892196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:31.898420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:31.900017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:31.917786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:31.918903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:31.920035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 264/500] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:31.920604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.949700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 237/501] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:31.950468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:31.974007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.030820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca03d5-bfa5-4344-b8ec-b040e9cce4b3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.049759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e014c6d-81fa-4104-9e1c-3b0b4f9d030c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.063483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.064148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.064425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.064698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.065534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:32.065839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.067272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.084590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.085378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.085681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.085958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.096366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:32.104226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:32.105093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:32.105901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:32.106530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 265/502] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:32.106530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.106661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 238/503] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:32.106661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.163693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.188103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.208449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace1a6b-c9cc-4813-a2c8-e0194670fce9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.214354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976370c2-3471-444a-a572-1a10d6e712f3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.243981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.244950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.245379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.245833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.247157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:32.247683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.249602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.249820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.250271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.250579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.250827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.251611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:32.251919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.253348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.261801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 266/504] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:32.262586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.292488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 239/505] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:32.293595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.366902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc63fd-4bb2-4a20-95d0-b07fd02e9c0f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.380618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.393000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3b100-b9ac-4bce-a92a-b5d85d2ae45d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.401374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.402247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.402537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.402815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.413288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.415268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.427823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d46428-f089-433d-a028-3456044248cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.428468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d46428-f089-433d-a028-3456044248cb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.428748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d46428-f089-433d-a028-3456044248cb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.429020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d46428-f089-433d-a028-3456044248cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:32.432565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:32.433671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:32.434511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:32.434511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:32.434511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:32.434511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:32.434511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 267/506] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:32.434836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.440326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.505203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d46428-f089-433d-a028-3456044248cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.506893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d46428-f089-433d-a028-3456044248cb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.537925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f071-0b16-45a8-a006-c392f59a55b8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.574052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.574834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.575185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.575558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.576311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:32.576626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.578000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.586016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 268/507] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:32.588318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.614575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 240/508] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:32.615431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d46428-f089-433d-a028-3456044248cb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.617774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.657142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.689965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e67d9d-ef86-4028-9bf2-dc25e0968d5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.717940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d46428-f089-433d-a028-3456044248cb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.723181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.723996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.724279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.724550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.734939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.736435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.751817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.752480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.752775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.753050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:32.753697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:32.754571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:32.755482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:32.755482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:32.755482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:32.755482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:32.755482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 269/509] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:32.755757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.821007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.822501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.843393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.862866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277218b-79f4-4c84-9e2f-ab62c8e21328 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:32.863719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:32.897573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:32.898247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:32.898535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:32.898816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:32.900106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:32.900417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:32.901804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:32.914003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 270/510] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:32.915586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:32.926185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 241/511] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:32.927096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.018080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5baa1-d2ba-4f24-a66b-f9d79ae60a92 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.025529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0bf83-a70b-49e2-9f74-6bb9e469ccf6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.053844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.054625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.054905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.055231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.059872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.060667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.060954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.061257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.063566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.065795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.067610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.069991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.073343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.074974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:33.087172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.088205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.089078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:33.089078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:33.089078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.089078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:33.089078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 271/512] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.089355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:33.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.094250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 242/513] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.095834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.189691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8366b-ae3f-4acf-be37-02ab495e2e89 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.193469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fc1a7-ce0b-4f3f-8e81-5698abb3cc19 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.222931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.223632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.223911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.224187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.224901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:33.225205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.226564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.227781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.228526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.228814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.229094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.229793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.231230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.238485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 272/514] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:33.239271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.259411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 243/515] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:33 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:33.259411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.308932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.318767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.364073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abbbc8-bd43-4b1e-9b83-7ea75d433f36 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.379730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4396e-44ce-450b-bf95-33b5664fd38c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.401411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.402227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.402510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.402783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.413825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.415414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.418701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.419488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.419829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.420108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.420913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:33.421223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.422643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:33.434838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.436258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.437270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:33.437270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:33.437270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:33.437270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:33.440530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 273/516] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.441385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.442661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 244/517] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:33.443583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.560272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd643f-a20f-4333-99d4-84650562ab15 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.560828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0350ac-5412-42c5-bc3f-590d97a7ceb4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.562595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.572268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.600484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.601432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.601814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.602898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.604556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.605324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.605507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.605777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.606860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:33.606860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.608183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.611676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.613220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.620292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 274/518] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:33.621106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:33.632883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.633857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:33.634774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:33.639026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 245/519] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.639687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.730423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d27412-4fa8-4eee-8da6-c50b22d04b39 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.745849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10b1a-bfa4-4420-8f48-bce5602f6ba8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.766944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.767641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.767913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.768194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.768909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:33.769214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.770644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.782504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.787567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 275/520] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:33.787711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.787711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.787711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.787933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.796776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.798714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:33.815295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.816427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 246/521] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.817330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.822687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.856260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:33.904291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65564572-0f8a-4c56-b774-8aa9db2eb70c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.941755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734939a9-395b-49ce-8dd1-e4ce6ce41ab6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:33.942692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.943524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.943811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.944801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.951395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.952987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:33.967537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:33.968646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:33.969525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 276/522] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:33.969990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:33.985375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:33.986050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:33.986340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:33.986617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:33.987496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:33.987809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:33.989273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.008173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 247/523] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.009044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.066691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.084973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef60cd-a411-4c5d-a71e-d40fd18d95bc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.103228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.119697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193d6c8-5034-45a1-92e5-2e21c38744dc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.129849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.131064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.131384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.131679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.141707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.143464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.156213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.156884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.157166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.157440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.158267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:34.158572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:34.158942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:34.159958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:34.160795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:34.161200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.161269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 277/524] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:34.161335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.183271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 248/525] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.188841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.271097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c583-3d77-4ca0-ac16-7f7ea3babb9e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.295966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822afc09-e839-4010-ae68-c193a9603607 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.307205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.307897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.308183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.308476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.309238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:34.309554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.310996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.330779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 278/526] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.332196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.336420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.337724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.338506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.338839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.339099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.354743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.411021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.412605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.444259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de876399-5878-4093-8b30-5cb0b13f5ae6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.481134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.481809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.482097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.482381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.483172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:34.483531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.484993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.497627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 279/527] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.498467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.529535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 249/528] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:34.531001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.568941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.583221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.609284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00d1e-da32-4b2b-808a-779a2f78b1ea None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.642512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c7c3-b802-4aba-aaf2-5a84ef4d2d2e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.644734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.645395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.645685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.645963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.679139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.680069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.681406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.681998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.682843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=544901ebce6e483cae9a9e03b3eac3ff) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:34.683158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.684650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.690774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 250/529] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/role_assignments?user.id=544901ebce6e483cae9a9e03b3eac3ff&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.691400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.734869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.736917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.811477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.840910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1f3a-e108-4561-80fa-52dedc79e510 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:34.858104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:34.866004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 280/530] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:34.867235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:34.899701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:34.900817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:34.901172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:34.901520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:34.902854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:34.903383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:34.904975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:34.915513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 251/531] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:34.916568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.039942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec6086-f99d-4538-8783-47ac35348f97 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.116696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.117424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.117711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.118625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.127883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368f007-6b78-40c6-b332-4d27749def94 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.147274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.149332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:35.184994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:35.185921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:35.186780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:35.186780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:35.186780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:35.186780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:35.192715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 281/532] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:35.198549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.204957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.205765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.206050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.206327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.226525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.228779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.243912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:35.248030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:35.248917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:35.249761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:35.249761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:35.249761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:35.249761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:35.249761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 252/533] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:35.255749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.306171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:35.425648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aaeb2-e426-48c1-8e24-33b47770e043 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.464377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5aee1-9bd0-45c1-bc84-ac48402420b3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.491184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.492140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.495085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.495418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.496183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:35.496503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.497912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.514291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 282/534] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:35.519767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.549010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.550374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.550839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.551294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.552250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:35.552736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.554292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1af1-45df-46d8-a610-52e3a41c583b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.588572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 253/535] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:35.594628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595328c1-25b5-498d-bfc0-505b63972d50 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.595139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595328c1-25b5-498d-bfc0-505b63972d50 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.595666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595328c1-25b5-498d-bfc0-505b63972d50 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.601173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 254/536] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:35.602155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595328c1-25b5-498d-bfc0-505b63972d50 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.636743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:35.668733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25da036-8e9f-42af-aadd-10055502035b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.707863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:35.715899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.717572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.718274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.718943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.729079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595328c1-25b5-498d-bfc0-505b63972d50 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.729395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.731322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e72c4e07-c379-4fd7-b255-72d3d54b28b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:35.750707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:35.751888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:35.752926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:35.755865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 283/537] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:35.757224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.757687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.758114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.778063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:35.778909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:35.779196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:35.779502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:35.781786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:35.783581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:35.787676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:35.788792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:35.804410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:35.805606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:35.806515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:35.815519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 255/538] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:35.816397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.875620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 284/539] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:35.876663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:35.952952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:35.956354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110902-dcbe-497b-af41-888e423f38eb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:35.998715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e70fea-b947-4e47-9fe7-e82507164688 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.002123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.002785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.003066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.003338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.004148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.004457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.005890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.030652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 256/540] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:36.031832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.036756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:36.039851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.041490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.041918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.043087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.044305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.044779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.046927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.065335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 285/541] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:36.066234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.161076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed74ba4-f0b1-4af6-ad30-9568a889cd24 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.184519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba1b66-9961-4a98-b597-d7217c6ad650 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.201225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.202240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.202696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.203119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.211678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:36.215309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:36.224037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:36.224450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:36.225492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:36.226456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:36.227066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.227066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.227066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.227066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=ee8345ccaca544058ac7df6888e6ab9b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.227066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.228087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.234087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 257/542] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:36.234283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 286/543] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/role_assignments?user.id=ee8345ccaca544058ac7df6888e6ab9b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:36.235073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.235429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.306719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:36.350061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66397d37-268f-4e40-a12f-1440994633b8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.350274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf87bf-92a6-4a01-a772-0896e336c177 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.391428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.392388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.392830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.393258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.394253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=d7bebb1f5cb1475c80dc46849e7cc78d) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.394733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.396393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.403607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 258/544] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/role_assignments?user.id=d7bebb1f5cb1475c80dc46849e7cc78d&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:36.416326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.417025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.417306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.417580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.418347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.418655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.420175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.429915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 287/545] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:36.436643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.592003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf89a0-1ebd-4a7f-ba7e-b21108d8857a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.623985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:36.633299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.634178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.634465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.634745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.646349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.647860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:36.667400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:36.668294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:36.669131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:36.669131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:36.669131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:36.669131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:36.669131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 259/546] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:36.674899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.733785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:36.785731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0b65-548a-42df-916d-d89063b1509e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:36.829404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:36.830251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:36.830545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:36.830826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:36.831601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:36.831914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:36.833291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:36.846580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 288/547] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:36.852420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:36.985595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063b4d4-584c-48f1-b40a-b737433ad6c2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.020951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.021819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.022110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.022390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.031391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:37.033011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8f6393f8-2fd5-4972-9c45-b5c373c705f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:37.048711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:37.050136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:37.051779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 260/548] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:37.056469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.203554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04e28-d75f-4191-8eb3-8563f3002d56 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.223383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:37.254228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.254913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.255083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92be8c-53cb-4b1b-9431-1acf7c12b76e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.255247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.255420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92be8c-53cb-4b1b-9431-1acf7c12b76e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.255587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.255733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92be8c-53cb-4b1b-9431-1acf7c12b76e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.256329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:37.256642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:37.257201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 261/549] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:37.258106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:37.262876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.263173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.263495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.284490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 289/550] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:37.290069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.299471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:37.300704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:37.393659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:37.416399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96624b-f542-48ae-8482-f2615aeac477 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.435149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 262/551] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:37.459606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.460584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.461106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.461583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.471647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.545966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:37.581033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:37.582840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16528cd-0ed9-49d1-91ab-35ab4b83887c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:37.615508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafed66-979e-4673-8b31-492eb78adceb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.654374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.655179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.655491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.655770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.666833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-98880218-0984-45a1-80d8-45404339dbe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:37.674838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:37.675913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:37.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:37.681184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 263/552] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:37.682836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583e26-ce07-4c91-809b-41203176e4b6 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.683132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583e26-ce07-4c91-809b-41203176e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.683434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41583e26-ce07-4c91-809b-41203176e4b6 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.685120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 264/553] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:37.685896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583e26-ce07-4c91-809b-41203176e4b6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.706902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 290/554] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:37.709010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.709507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.710048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.728997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:37.730603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:37.731761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:37.800157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:37.812349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 291/555] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:37.813660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.829776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41583e26-ce07-4c91-809b-41203176e4b6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.878734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.879445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.879734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.880016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.880862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:37.881174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:37.882687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:37.895878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 265/556] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:37.896903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:37.931583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecaf5-c7f6-4e30-a650-2c3848831930 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:37.969913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:37.971175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:37.971702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:37.972219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:37.983190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:37.985009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.003492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:38.004657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.005594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.006784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:38.006784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:38.006784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.006784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:38.009261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 292/557] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.010584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.018105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9688af-4166-4c17-9fda-ba19744cdf8f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.055022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.056408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.056692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.056965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.067712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.069345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:38.081798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.083351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:38.084396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:38.092725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 266/558] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.092725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.133487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bc973-dd35-484c-a9c6-0bbcb78adf02 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.172128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.173505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.173505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.173505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.185496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.187022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:38.205065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.205978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.206928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:38.206928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:38.206928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.206928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:38.210902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975971-c317-49b6-b998-4f5cf3a6edb6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.211024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 293/559] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.211847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.255866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.256897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.257667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.258104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.259478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:38.260387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.262099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.279326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 267/560] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:38.280468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.297938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.326877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828995-98fe-4e96-96dc-3dae03a8917f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.329709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.375528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.376493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.376932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.377895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.378798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:38.379269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.381713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.393765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 294/561] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:38.394783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.409766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c4348-5fd3-4f33-97b0-4e489eb29541 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.447784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.448685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.449252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.449442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.450338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:38.450806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.452326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.469888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 268/562] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:38.471029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.516832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bee61-fd2d-4a54-abd8-2b9cfdf1031e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.549119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.555599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.557469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.558016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.558678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.566679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.568544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.583728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191a06-9c32-4979-8da7-01ecf8675420 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:38.593658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.595106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:38.597684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:38.602171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 295/563] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.604288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.626730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.627596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.627903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.628569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.640725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.642462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.645975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:38.664568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.666150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.667051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:38.667051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:38.667051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:38.667051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:38.671563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 269/564] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.672783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.738436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cfdb4-c711-4b85-a637-7db5f7eef1b8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.776227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.777524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.778019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.778524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.786495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197539b7-1415-4414-9037-9829bdae3269 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.786890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.788801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:38.804581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:38.805583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:38.807188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:38.810452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 296/565] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:38.811536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.829140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.844238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.844982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.845298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.845960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.846487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:38.846809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.848349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.863873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 270/566] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:38.865083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.913075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:38.929016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8302fe3-cc48-47b6-a1ab-779ae258ddd6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:38.968877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:38.969810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.970258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.970534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.971266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:38.971600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:38.972974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a115-3db8-434a-83e7-9eeed558ea28 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:38.985152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 297/567] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:38.986436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38660-703a-4e71-a6ec-e8a1cbdb8648 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:38.986725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38660-703a-4e71-a6ec-e8a1cbdb8648 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:38.987004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a38660-703a-4e71-a6ec-e8a1cbdb8648 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:38.991413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 298/568] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:38.991413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38660-703a-4e71-a6ec-e8a1cbdb8648 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:38.992030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225313-6612-4cba-9d64-8246d60bbf0b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.029330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.029921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.030205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.030475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.031314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:39.031662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.033092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.050755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 271/569] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:39.051499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.094158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.097996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a38660-703a-4e71-a6ec-e8a1cbdb8648 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.132004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.132671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.132946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.133222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.134609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=7457fcf08cac43a3831a145946f12bc7) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:39.135077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.136351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1f512-2277-4362-b588-85394809f324 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.141747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 299/570] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:38 2022] GET /identity/v3/role_assignments?user.id=7457fcf08cac43a3831a145946f12bc7&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:39.142917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.143218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.143516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.153711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e84f3-af51-4e7d-a463-a7d188087a65 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.170383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:39.171787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:39.175948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.193831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.194640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.194924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.195198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.204702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.206237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6d2e7ed0-a343-408f-aa60-8793d4f31aae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:39.222435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:39.223492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:39.224517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:39.229085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 272/571] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:39.230426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4c7b4-c231-45a9-86c6-c519864646df None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.230720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4c7b4-c231-45a9-86c6-c519864646df None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.231010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4c7b4-c231-45a9-86c6-c519864646df None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.232600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 273/572] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:39.233204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4c7b4-c231-45a9-86c6-c519864646df None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.258263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 300/573] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:39.260279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.357929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4c7b4-c231-45a9-86c6-c519864646df None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.359581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.390743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48900-8c3d-47fd-bf2e-4b3989f48eb7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.400953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.402146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.402428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.402698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.414287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.417122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.428158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.428840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.429124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.429401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.430234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:39.430542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.432062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-37973cf7-ebcc-4ab8-9770-ab28221a8b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:39.435801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:39.436639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:39.437498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:39.437498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:39.437498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:39.437498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:39.437498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 274/574] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:39.438637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.438919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.439188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.446781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.455682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 301/575] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:39.456481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.462986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:39.464450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:39.541657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 275/576] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:39.542478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.568789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95425a3b-2de6-4a7d-a21c-246916e98534 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.605681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.606692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.606812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.607018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.618618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:39.628148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:39.629111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:39.629948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:39.633745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 302/577] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:39.634466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.651065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.670690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb68d82-e38c-4bd1-ace2-0ad5c5884f94 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.698201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.710522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.711297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.711628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.711910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.713192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:39.713493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.714874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.731504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 276/578] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:39.731504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.750943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee69462-3ec9-4404-bc9a-ec61ebdd8e64 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.788019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.788819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.789100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.789374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.801214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.803242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:39.824866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:39.825990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:39.827602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:39.827602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:39.827602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:39.827602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:39.830634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 303/579] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:39.831504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.839427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce5f5e-a891-447b-8955-9e90cd5292a9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.874760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.875533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.875820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.876157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.887496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:39.895188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:39.896121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:39.896956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 277/580] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:39.897635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:39.902994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.951912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56280fb-eafd-4d70-bf2b-587727cb4118 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:39.963614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:39.991168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:39.991876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:39.992166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:39.992863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:39.993780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:39.994367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:39.996314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.005418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc343176-5b47-43c0-9646-867c5b6140db None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.010196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 304/581] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.010875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.040740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.041573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.041857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.042129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.048774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.050206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:40.064202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:40.065266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 278/582] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:40.066168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.122970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669934d-83a6-40a3-8887-ad69872931fb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.136301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.159295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.159995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.160278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.160569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.161496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.161609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.162934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.175448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 305/583] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.176118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.182080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182d3be-4739-4613-99ea-a3c77bc319d2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.214003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.222301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.222972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.223256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.223558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.224301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.224606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.225969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.239028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 279/584] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.239028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.296414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a787df-37db-4708-a449-1c529a24a9f8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.334695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.335634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.335915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.336343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.347350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.348936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.352795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac8f4b-eaa4-455e-9545-9f286eced4ae None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:40.367132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:40.368209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:40.369687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:40.369687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:40.369687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:40.369687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:40.369687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 306/585] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:40.369961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.385669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.396196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.396889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.397243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.397529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.398374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.398691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.400370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.412779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 280/586] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.413576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.465584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.483984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47704e-d625-48f3-8d21-64f612b138be None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.516212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf29cce-2978-4860-955b-9a53c72f83c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.519823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.520782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.521212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.521662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.529055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.530881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:40.546590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:40.547698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:40.548790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:40.550619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49428-159b-42db-af4b-616d06183912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.550972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 307/587] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:40.551445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49428-159b-42db-af4b-616d06183912 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.551735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49428-159b-42db-af4b-616d06183912 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.552014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c49428-159b-42db-af4b-616d06183912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.552370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.565444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c49428-159b-42db-af4b-616d06183912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.566904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c49428-159b-42db-af4b-616d06183912 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-46c49428-159b-42db-af4b-616d06183912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:40.585729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:40.586808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 281/588] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:40.587974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49428-159b-42db-af4b-616d06183912 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.636948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.670091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5024265-05fe-4265-b1df-2f66499f4530 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.704305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c49428-159b-42db-af4b-616d06183912 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.710633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.711307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.711620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.711904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.712796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.713189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.714573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.726232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 308/589] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.727039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.735089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.747063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.747991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.748276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.748782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/544901ebce6e483cae9a9e03b3eac3ff/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.764906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=544901ebce6e483cae9a9e03b3eac3ff, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.766399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.781249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 282/590] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:40 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/544901ebce6e483cae9a9e03b3eac3ff/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:40.782352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.867150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bae5bc-bb1e-4543-abca-f02c0774a638 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.917420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.918452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.918921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.919422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.920645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:40.922579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.923111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.925647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:40.941247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c8a6a-9e7b-408c-a1e6-db937b67d11e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:40.946050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 309/591] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:40.946917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:40.986365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:40.987259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:40.988135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:40.988738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:40.990572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:40.991091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:40.992828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.010386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 283/592] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:41.011356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.045298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.102072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda661-455f-450b-86aa-8736a7a5007d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.128719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d58d2-8a96-4b48-a13e-5ba02c6fcaeb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.153610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.154900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.155397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.156068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.168232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.168928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.170023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.170363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.170488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.170914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:41.189774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:41.190976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:41.192179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:41.193444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=b485e0918e744da9875e48e7906264e9, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.194319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 310/593] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:41.195344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.195514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.209164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.218508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 284/594] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:41 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:41.220022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.351824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612008ce-e2ec-4f3a-858a-88bef65d2f0c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.390661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440fd62-2938-4a5f-b576-bbc7f543b8d2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.399278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.400350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.400806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.401673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.403000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:41.403638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.405558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7845d8-4249-4d5d-ba13-418275a00adc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.427839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.429433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.430441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.430925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.431576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.432083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 285/595] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:41.433764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ec30-3c3a-46f9-9651-a67318fd6976 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.434033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ec30-3c3a-46f9-9651-a67318fd6976 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.434311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5ec30-3c3a-46f9-9651-a67318fd6976 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.439439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 286/596] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:41.439439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ec30-3c3a-46f9-9651-a67318fd6976 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.446324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.448804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e8f50384-8bc5-4380-86d6-8fda4f998773 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:41.465805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:41.466768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:41.468137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 311/597] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:41.468718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.469291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.469452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.499155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:41.500665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:41.513326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.570829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5ec30-3c3a-46f9-9651-a67318fd6976 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.590555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 312/598] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:41.591879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.634388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.635215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.635545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.636058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.655552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.657172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:41.675840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:41.676780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:41.677650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:41.677650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:41.677650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:41.677650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:41.677650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 287/599] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:41.678894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.728724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516e38-a675-4316-9a7f-41dbe8a9b78e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.748441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.778286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.779231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.779620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.779964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.780897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:41.781598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.782773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:41.797377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63cc27-ab88-4691-bdb6-922fbc58bebb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.802043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 313/600] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:41.807036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.810497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:41.851280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.852341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.852775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.853788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.867488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:41.878946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:41.880140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:41.881191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:41.889134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 288/601] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:41.889134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:41.934457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98276e5-c43c-412c-a5ef-4c7020bfedea None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:41.983278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:41.984218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:41.984661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:41.985327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:41.986684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:41.987435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:41.989235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.006852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab3501-1f3c-4f99-84df-ca4c147d86b7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.007127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 314/602] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.008293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.051560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.063039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.064750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.064907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.065291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.079933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.081647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:42.107248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:42.108327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:42.109212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:42.109212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:42.109212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:42.109212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:42.114251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 289/603] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:42.115612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.139674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0495-aee8-42d7-959e-feae66319d54 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.145365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.180622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.181902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.182182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.182448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.183378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:42.183707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.185495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.195650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 315/604] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.197585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.252567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675aff5-1c6b-467d-9637-3ceb84bf1a0c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.295898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.297237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.297700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.298274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.307105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.309238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.312806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.321138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377196f-91b9-4de8-8510-a8fd13d37d9e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:42.327846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:42.328753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:42.329638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:42.336565 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 290/605] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:42.336565 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.367035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.367740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.368026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.368306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.369818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:42.370228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.371777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.391446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 316/606] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.392618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.442734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.466504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50017d-b7f5-4725-922d-784b3cc761d5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.506914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.507816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.508102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.508433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.510597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a0081-0e0c-4f27-b696-06f7a33961a5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.520385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.521957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:42.541699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:42.542660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:42.543569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:42.543569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:42.543569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:42.543569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:42.547440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 291/607] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:42.548552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.552560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.553225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.553509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.553786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.554799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:42.554912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.556914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.574825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 317/608] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.575960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.594752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.667486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4067b6f-98d5-4458-989b-cb97e497310f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.686058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52609-5ace-4e1c-a8b8-9d5456b44b54 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.701797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.707682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.708993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.709500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.709987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.717959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.720189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.723576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.724331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.724681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.725023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.725817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:42.726185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.727628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:42.737301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:42.738177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:42.739044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:42.746058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 318/610] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.746209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 292/610] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:42.747017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.747558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.829710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:42.860116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335ff3-d50e-426f-99c1-f1912ce7dde3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.863205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb663a-92e9-4de0-8548-e978e7b72554 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:42.897558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.898547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.898897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.899242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/ee8345ccaca544058ac7df6888e6ab9b/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.902338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:42.903392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:42.903904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:42.904359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:42.905321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:42.905806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.907557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.917259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=ee8345ccaca544058ac7df6888e6ab9b, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:42.919129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:42.927746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 293/611] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:42.927746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:42.940216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 319/612] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:42 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/ee8345ccaca544058ac7df6888e6ab9b/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:42.942710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.071728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.083939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a490542-1ff8-45a6-b4fa-8edc5033e4d1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.116302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.131721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.133030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.134093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.134736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/d7bebb1f5cb1475c80dc46849e7cc78d/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.157038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=d7bebb1f5cb1475c80dc46849e7cc78d, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.159742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8ceb1-337b-40b0-bf18-cfd96443fa67 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.168770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb09c6-f153-4ed0-9f4b-bb46f071a4e3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.178317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 320/613] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:42 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/d7bebb1f5cb1475c80dc46849e7cc78d/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:43.183529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc27d4-50bf-4777-9521-9a43a9e6154f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.183529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc27d4-50bf-4777-9521-9a43a9e6154f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.183529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc27d4-50bf-4777-9521-9a43a9e6154f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.188678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 321/614] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:43.191223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.191595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.191883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.214556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:43.216492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:43.232523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.233337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.233678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.233948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.242416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.244707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:43.262075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:43.263064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:43.264049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 294/615] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:43.269429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.307472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 322/616] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:43.336314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.412382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137555f-5f41-4d92-b1b4-07c8e966a2b0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.432223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.462856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.464110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.464650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.465176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.466221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:43.466751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.468553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.483039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418ca9b-a099-4e09-bbb5-8799ee5a83dc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.488188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.491155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 295/617] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:43.496946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.527716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.528611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.528906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.529185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.540509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:43.549286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:43.550226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:43.551065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:43.555398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 323/618] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:43.556673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.628528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcf5e9-4518-4161-a211-2ee5e1b16e65 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.669686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.671099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.671623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.672118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.684643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.686514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:43.708218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:43.709186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:43.710108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:43.710108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:43.710108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:43.710108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:43.712635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 296/619] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:43.718545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.744421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262153a-e42d-4a00-b38d-d899b55fb99b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.757811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.788984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.789671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.789956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.790233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.791239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:43.791649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.793374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc45a-2d32-4fe7-81af-4923dd189806 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.804910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 324/620] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:43.807314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724593a8-9b89-4928-b2a1-6d03048388ff None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.807621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724593a8-9b89-4928-b2a1-6d03048388ff None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.807898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724593a8-9b89-4928-b2a1-6d03048388ff None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.809270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 325/621] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:43.811025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724593a8-9b89-4928-b2a1-6d03048388ff None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:43.850602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:43.860106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c86152-d1c4-4548-92bb-3f0bac8d813b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.904504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.905111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.905424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.905703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.906558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:43.906869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:43.908396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e392a9-f74e-47fd-b7d9-fe6e28e2989e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:43.921500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 297/622] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:43.922964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.923258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:43.923634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:43.944480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:43.945878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:43.953433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724593a8-9b89-4928-b2a1-6d03048388ff None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:43.998385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:43.999353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:43.999665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.000323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.013106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.015211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.021815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 298/623] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:44.022888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:44.039541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:44.040458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:44.041442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:44.041442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:44.041442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:44.041442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:44.041442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 326/624] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:44.042031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.046444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.151485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.162597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1343a-d6e7-4364-ab3b-db097ada7a08 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.183237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b1982-5991-44cc-b9ac-c7d47c391982 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.205848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.207555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.208347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.208831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.219515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.221310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.221420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.222192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.222500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.222828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.223594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:44.223903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.225265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.238226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 327/625] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:44.239113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:44.240776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:44.241721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:44.242610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:44.244908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 299/626] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:44.250656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.351322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.352878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cf43-3039-4dc2-8da8-cc0fe71e2508 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.389688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22edf-5692-431c-8df9-be7f5828ac42 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.391091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.391927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.392263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.392547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.399931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.403895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:44.412689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:44.413675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:44.414520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:44.423683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 328/627] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:44.423683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.440930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.442107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.442397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.442734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.453600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.455601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:44.473129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:44.474137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:44.475108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 300/628] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:44.475744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.566874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b53d48-b4ed-45eb-a291-ce242ee3a897 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.595534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4e6ef-12b9-4e55-b030-56fee3727d27 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.605299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.605980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.606268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.606551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.607348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:44.607718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.609140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.627611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 329/629] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:44.628775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.630946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.638371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.639394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.639888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.640365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.641320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:44.641830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.643449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.657516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 301/630] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:44.658640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.693101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.737626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f3e70-41af-47ee-a75e-07abbe9aeeb1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.770630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05760029-df9c-44c7-905c-5c3059f85ddc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.772926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.774241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.774241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.774241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.774972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:44.775883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.777548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.796040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 330/631] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:44.797121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.813260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.814614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.815103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.815629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/7457fcf08cac43a3831a145946f12bc7/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.834143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=7457fcf08cac43a3831a145946f12bc7, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.836139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.859465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 302/632] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:44 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/7457fcf08cac43a3831a145946f12bc7/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:14:44.860804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:44.919409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7b70-6466-4ec4-95d6-23f54b8e3d56 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:44.933930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.948699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:44.955774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:44.957318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:44.957834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:44.958317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:44.970587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:44.972512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:44.994244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:44.995749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:44.996658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:44.996658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:44.996658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:44.996658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:45.005236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 331/633] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:45.012753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.076967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5510-42a7-442d-b257-629e56b2c4b5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.157529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.158581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.158864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.159138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.202563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19567010-cdee-42f8-b085-db0ee3b5514b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.241974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.243548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.250606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.251641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.252289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.252773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.253712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:45.254773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.256858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.273496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 332/634] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:45.279096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.312374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:45.350432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:45.406713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf393a5-6e98-4654-a789-467ee6bf8624 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.448490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.450209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.450727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.451209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.459704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.461755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:45.480383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:45.481399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:45.482344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:45.485544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 333/635] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:45.491110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.505971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 303/636] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:45.511909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.599530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:45.617702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344fcb7-9abb-45fc-aefe-66343c04c150 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.649613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839961f-de1d-4a5e-bff7-277b1c1ec688 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.665156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.665859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.666766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.667234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.668233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:45.668542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.669991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a66e0-f091-42f4-bcc8-c16393c3185e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.694130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 334/637] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:45.694130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffacac-9a94-474b-a937-b0b5087877d0 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.694130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffacac-9a94-474b-a937-b0b5087877d0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.694130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffacac-9a94-474b-a937-b0b5087877d0 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.694130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 335/638] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:45.695501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffacac-9a94-474b-a937-b0b5087877d0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.710350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.711376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.711972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.712402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.726733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.729564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.733432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ccd37b68-2ed5-4b83-99a5-25c84349b89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:45.751271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:45.752375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:45.753267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:45.753267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:45.753267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:45.753267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:45.753267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 304/639] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:45.754050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a9f-30ac-449b-ac4c-b0ce3949ce98 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.754214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a9f-30ac-449b-ac4c-b0ce3949ce98 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.754487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a9f-30ac-449b-ac4c-b0ce3949ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.771435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a1373a9f-30ac-449b-ac4c-b0ce3949ce98 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:45.772671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a1373a9f-30ac-449b-ac4c-b0ce3949ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:45.831247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffacac-9a94-474b-a937-b0b5087877d0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:45.846779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 305/640] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:45.852868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6200b-4a42-4c98-bf65-60dbd82b7228 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.854650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6200b-4a42-4c98-bf65-60dbd82b7228 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.855194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6200b-4a42-4c98-bf65-60dbd82b7228 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.857482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 306/641] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:45.858976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6200b-4a42-4c98-bf65-60dbd82b7228 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:45.869600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:45.870431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:45.870872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:45.871566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:45.889501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:45.949504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:45.951576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:45.972323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6200b-4a42-4c98-bf65-60dbd82b7228 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.004843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.016143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.016806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.017089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.017363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.018092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.018401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.019834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa139ff-4619-4c35-9a36-fc4b3ed61b1a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.037545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 307/642] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:46.037545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.037545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.037545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.055031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:46.056361 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:46.059568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 336/643] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:46.060478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.107256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.141156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 308/644] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:46.141156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.169758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096da97-14ec-472b-b98d-c1cf50c49f94 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.206485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.207277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.207590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.207861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.220510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:46.229328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:46.230585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:46.231497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 337/645] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:46.232206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.255166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1385f6-5560-4209-a29c-f295ce1f8e4e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.274088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.295062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.295987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.296322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.296615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.304047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.305607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:46.321513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:46.322603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:46.323845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:46.327394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 309/646] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:46.328216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.336862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936b2c-2762-4b11-87a6-d33ce64d6049 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.344751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.373698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.374492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.374772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.375040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.385794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.387249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:46.405115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:46.406028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:46.406936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:46.406936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:46.406936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:46.406936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:46.406936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 338/647] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:46.407215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.441844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83d32-8508-45e8-a996-3119c42236c6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.479193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.480009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.480198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.480434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.490758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:46.499781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:46.500888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:46.501751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 310/648] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:46.502432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.519497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1969ec4-4a4a-46d7-bdc6-ab247edbf280 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.541903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.554248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.554922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.555205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.555513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.556258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.556632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.558005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.566343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 339/649] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:46.567116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.592702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.619290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d6b1b-e592-42a7-b43b-dadc1e109d2a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.656602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.657265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.657554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.657823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.658607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.658918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.660387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.673112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 311/650] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:46.673112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.682006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd479-34e9-452a-afbf-63aa53bfe9da None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.717616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.718286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.718567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.718843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.719850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.720155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.721537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.734081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 340/651] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:46.734661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.778823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.785476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427d60-3dad-4c0b-aabf-bf668870d57b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.825723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:46.829969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.830659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.830944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.831218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.832019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.832328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.834297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.843393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 312/652] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:46.844173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.853514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bdade7-e0ca-4906-84e0-abfd1a71d02f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.891197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.892028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.892315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.892595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.903406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.904861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:46.922668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:46.923643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:46.924749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:46.924749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:46.924749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:46.924749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:46.928424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 341/653] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:46.929316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:46.957338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375adac-60a6-44d5-a02a-967958c08726 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:46.994757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:46.995395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:46.995687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:46.995963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:46.996793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=544901ebce6e483cae9a9e03b3eac3ff) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:46.997102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:46.998534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.012757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 313/654] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/role_assignments?user.id=544901ebce6e483cae9a9e03b3eac3ff&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:47.012757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.042678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f8fc2-3b2d-4c11-88b4-22ea53478631 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.050201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.086956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.099838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.100657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.100937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.101208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.113265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.115162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:47.137110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:47.138142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:47.139019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:47.146405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 342/655] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:47.146405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.162838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd6e51-2f92-4223-b35c-aaee0dae94a6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.218483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.220311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.220845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.221266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.236313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.238026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:47.258336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:47.259445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:47.261227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:47.261227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:47.261227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:47.261227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:47.262814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 314/656] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:47.263847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.287651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143478-7f9d-46e3-afee-39904a2e25dc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.329698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.330367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.330648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.330921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.331701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:47.332005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.333368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.346278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 343/657] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:47.347127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.360698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.390472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b01b23-6a5c-48a3-b812-27fcf2c97e66 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.404755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.427248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.427946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.428265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.428545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.429338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:47.429648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.431122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c757-501c-455f-a4c8-27f835025855 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.455252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 315/658] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:47.455252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf463-9770-4d37-858f-5bef5c15002b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.455252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf463-9770-4d37-858f-5bef5c15002b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.455252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bf463-9770-4d37-858f-5bef5c15002b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.456285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 316/659] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:47.459555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf463-9770-4d37-858f-5bef5c15002b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.577452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bf463-9770-4d37-858f-5bef5c15002b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.579531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf6d9-d029-4e85-8eb2-531a65a0a871 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.613443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784286d6-77d8-4082-abda-74825b668026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.613795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.614240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286d6-77d8-4082-abda-74825b668026 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.614446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.614556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286d6-77d8-4082-abda-74825b668026 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.614730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.614838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784286d6-77d8-4082-abda-74825b668026 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.614998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.615757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:47.616066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.616733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.617435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.624747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784286d6-77d8-4082-abda-74825b668026 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.626692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784286d6-77d8-4082-abda-74825b668026 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.635502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 344/660] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:47.635502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-784286d6-77d8-4082-abda-74825b668026 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:47.642495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:47.643637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:47.644615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 317/661] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:47.645302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.645591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.645865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.663611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:47.664771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:47.743478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413750b-7c28-42f3-b603-d9b5a071a3da None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.743679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 318/662] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:47.743679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.764743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.788406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.789058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.789341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.789611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.790433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:47.790740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.792895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.799087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 345/663] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:47.799923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.885325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565e61c-7573-4d8e-916d-40267e9511ef None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.915778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:47.933307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.934378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.934817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.935103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.943401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.944048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b6346-aa43-4ffa-bb37-f034046fd234 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:47.944920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:47.961184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:47.962270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:47.963256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 319/664] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:47.963897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:47.987547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:47.988390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:47.989255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:47.989641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:47.990930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:47.991385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:47.993827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.025849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 346/665] 10.222.0.46 () {56 vars in 1137 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:48.026941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.069236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.085329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc8a7-2d0f-403e-8126-496af134c8f9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.132034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.133040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.133599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.133898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.148220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:48.150879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d20858-accc-416b-ad85-5d5c391c0c2a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:48.156278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:48.157216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:48.158058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 320/666] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:48.158770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.194555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.195235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.195571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.195845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.196682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:48.196985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.198954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.217839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 347/667] 10.222.0.46 () {56 vars in 1139 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:48.219031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.235049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.304083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978054d-65f7-46a4-a4f5-61b7b36db827 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.343223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.345675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.346364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.346644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.346918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.358608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fd915-d469-4f8b-94fb-5d71c12ce324 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.403133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.403784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.404064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.404338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.405251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:48.405609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.407652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.422708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 348/668] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:48.422708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.439089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.440590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.507465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.548274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0c33-3ef0-42b6-bf97-a5e6e0e6ea19 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.574126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 321/669] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:48.575006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.602078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.603241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.603646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.604867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.636636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.688715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f8d40-c314-46e9-b4f1-24b22358c528 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.700598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.702718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.734727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.736036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.736464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.737269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.752194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.754718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.758327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:48.780977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:48.781935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:48.782815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:48.782815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:48.782815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:48.782815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:48.786687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 322/670] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:48.788346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.830504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 349/671] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:48.830504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:48.887713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:48.936399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5cddd-27e2-40b1-9de2-513ef6d2434e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.941382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95afdb-2456-4dd8-85d4-f62781e4ce18 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:48.978579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.980165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.980570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:48.980899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.981358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:48.981583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.981681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:48.981900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:48.982804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:48.983297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.985568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:48.992624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:48.994323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.001133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 350/672] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:49.002779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:49.014032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:49.015049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:49.016404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:49.016404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:49.016404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:49.016404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:49.019519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 323/673] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:49.020436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.074249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.135705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea924f80-b2c3-4e8c-8ed3-2196e37b65f8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.139439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baf2ff-cc7e-4f80-b54d-4c5741f7b986 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.151605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.175767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.176463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.176737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.177011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.188506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.189935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.190269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.191211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.191966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.192817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.202154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.203904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:49.208079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:49.209194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:49.210257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:49.210257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:49.210257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:49.210257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:49.214966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 351/674] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:49.216034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:49.226140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:49.227403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:49.228566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:49.233020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 324/675] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:49.234734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.334684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5516-52a1-47d9-b117-5a55e7191a66 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.366473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153ea4-50dd-41dd-b4dc-21796a9141f9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.372070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.372946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.373379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.373794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.374656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:49.375100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.376717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.377719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.392178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 352/676] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:49.393330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.409604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.410477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.410626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.410810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.411566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:49.411872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.413282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.423034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.427514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 325/677] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:49.427514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.502788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf60d1-6cfb-40b8-a0f7-2aa82c35afdb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.534804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491bdb6-3fd4-4612-a441-429d97963e86 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.539211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.539913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.540193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.540467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.541839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:49.542376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.544285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd10a2c-84cf-4ef3-84d3-1ad39cf04fda None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 353/678] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7327a-2389-4417-b936-d143483b1ef6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7327a-2389-4417-b936-d143483b1ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7327a-2389-4417-b936-d143483b1ef6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 354/679] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:49.569548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7327a-2389-4417-b936-d143483b1ef6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.580336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.581185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.581456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.581735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.590110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.591598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:49.607974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:49.608908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:49.609799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 326/680] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:49.610297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.640644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.666541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.686925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7327a-2389-4417-b936-d143483b1ef6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.727425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.728251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.728535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.728811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.736804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.738277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8b82f95b-f29d-4cc1-9ec7-680e946281ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:49.753387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:49.754340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 355/681] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.761139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.761771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.778438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:49.779666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:49.847828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcc05-1209-4731-a9d4-27da8f37ef7b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.867386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 356/682] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:49.867386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:49.882461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:49.883249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:49.883563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:49.883842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:49.949580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:49.958514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:49.960004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:49.976332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87449-63d8-471b-8af1-4cd3b091deb9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:49.989479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.013769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.014358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.014638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.014911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.015734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.016037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.017450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.030697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 357/683] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.031313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.076067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 327/684] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:50.076646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.149251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b632d-7871-4f0f-87df-c92cfe2b7108 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.185098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.186067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.186449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.186720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.187441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.187754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.188551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5145f-3c14-469c-a47f-0150591161d9 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.189190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.191607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.202624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 358/685] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.203469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.222897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.232286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.233080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.233360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.233629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.245563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.247474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:50.266133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:50.267106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:50.268025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:50.268025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:50.268025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:50.268025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:50.268025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 328/686] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:50.268300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.313990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0923-c771-464c-a294-9494bd3edc93 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.348166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.348824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.349105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.349381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.350215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=ee8345ccaca544058ac7df6888e6ab9b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.350522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.352074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.357829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 359/687] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/role_assignments?user.id=ee8345ccaca544058ac7df6888e6ab9b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.358604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.381787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fe69-656e-4f3f-89bf-ab1545121d24 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.419872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.420684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.420969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.421250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.424119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.433977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.435515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:50.454169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:50.455151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:50.456099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:50.456099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:50.456099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:50.456099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:50.456099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 329/688] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:50.456402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.481773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf360-a678-4c26-a336-21941d5b1a56 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.492456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.522962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.523609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.523847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.524123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.524965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=d7bebb1f5cb1475c80dc46849e7cc78d) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.525273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.527340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666c167-9590-4f47-b89e-366154dad2f9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.533985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 360/689] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/role_assignments?user.id=d7bebb1f5cb1475c80dc46849e7cc78d&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.535203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f9af-6bcf-4b91-b6a7-3079677ea63d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.535521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f9af-6bcf-4b91-b6a7-3079677ea63d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.535799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254f9af-6bcf-4b91-b6a7-3079677ea63d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.542338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 361/690] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:50.542338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254f9af-6bcf-4b91-b6a7-3079677ea63d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.589238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335aafe-6fdb-4f14-bbd7-d4befff0d2eb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.632909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.633588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.633866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.634148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.634997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.635444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.637323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995d098-b4d4-444d-9084-7b9610efe98a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.653442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 330/691] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.658051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.658051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.658051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.677849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254f9af-6bcf-4b91-b6a7-3079677ea63d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.684672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:50.686975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:50.706678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.718406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.719262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.719663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.720286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.721140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:50.721521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.723222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.737348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 362/692] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:50.738505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.782843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 331/693] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:50.784219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.820743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:50.883275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd776493-1632-4440-8bdb-e8595e384800 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.923343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d186a-884e-45ed-a371-a18c54216430 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:50.927326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.928113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.928474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.928827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.929617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.931123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:50.958450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 363/694] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:14:50 2022] POST /identity/v3/users => generated 254 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:50.959503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:50.982630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:50.983518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:50.983800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:50.984071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:50.991996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:50.993503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:51.023338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:51.024502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:51.025901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 332/695] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:51.030546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.031325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:51.099240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aecd6-213c-47b4-8a57-85b525576f30 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.143125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.147448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.147448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.147448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.158424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:51.167749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:51.168921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:51.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:51.172193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 364/696] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:51.178450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.225738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:51.248424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1405637-4ccd-4a62-90df-6041cd0415a4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.285292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.285991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.286276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.286553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.287344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:51.287710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.289280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.298356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:51.303187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183b2d1-de93-4da4-8bad-11ee8069a75d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.306309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 333/697] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:51.312387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.343284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.344055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.344471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.344846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.346063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:51.346595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.348172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.359652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 365/698] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:51.369413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.444057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bb62f-333a-4ca3-950d-1f46445b525d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.483204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.483982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.484270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.484545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.485428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=7457fcf08cac43a3831a145946f12bc7) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:51.485746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.487189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.494043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 334/699] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/role_assignments?user.id=7457fcf08cac43a3831a145946f12bc7&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:51.510284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c402d9-7b7b-4062-b2bc-9c9207e8772a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.550947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.552102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.552540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.552969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.565885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.567681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:51.587405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:51.589154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:51.590389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:51.590389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:51.590389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:51.590389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:51.592586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 366/700] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:51.600123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.610931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:51.720099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0d44-61d1-425e-be6e-0de1a00745aa None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.758460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.759395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.759828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.760371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.761385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:51.761849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.763398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.776381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 335/701] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:51.781962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:51.805977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:51.891353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab543cd6-99cc-41a4-a2dc-e368c803de45 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:51.927964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:51.928785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:51.929074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:51.929355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:51.937703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:51.939196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:51.956619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:51.957629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:51.959216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 367/702] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:51.964444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:52.060577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:52.099848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003bb5-e302-4bb5-835a-0bd4811bb790 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:52.136459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:52.137207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:52.137495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:52.137773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:52.138669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:52.138985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:52.140457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:52.167757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 336/703] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:14:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:52.173166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:52.271149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:52.309962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2fe1-ec79-4ed6-8e08-795094ccc9d9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:52.356708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:52.357372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:52.357659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:52.357938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:52.431631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:52.433652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:52.528835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:52.569943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 368/704] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:52.575399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:52.722691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7c08-0970-4e23-8424-9a28024c0bd4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:52.759334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:52.777230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:52.778411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:52.778899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:52.779402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:52.790635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:52.792942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:52.826687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:52.827649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:52.828577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:52.828577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:52.828577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:52.828577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:52.831231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 337/705] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:52.839413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:52.989182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad73982-6516-455c-a6b5-14098569eec6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.037011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.037731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.038022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.038299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.039027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:53.039332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.040792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3734282-1605-4ba6-952a-5e408256ff9b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.058262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 369/706] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:53.063281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.079814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18555cc-7064-4977-8336-6bdabb9c6986 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.080089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18555cc-7064-4977-8336-6bdabb9c6986 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.080370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18555cc-7064-4977-8336-6bdabb9c6986 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.082093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 370/707] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:53.087500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.087828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.088109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.108402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:53.109827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:53.141067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:53.196651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 371/708] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 23 15:14:53.232401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.262311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379c97-452c-4624-87b3-0f2d69ee413b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.301109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.301908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.302245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.302516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.314838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.316774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:53.331775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:53.332702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:53.334211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 338/709] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:53.338749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.378398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:53.457947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc38e-069f-4391-9916-53c4f797cae5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.467840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3021e-b9b7-493c-b42a-fe1f12eac3b5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.502663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.503523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.503789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.504063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.504720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.505090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.505966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.506071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.506551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.507095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.508105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:53.508613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.510234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681531dd-e5a9-4b5e-8527-089faffdebb6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4c2457e2-2281-4d30-b215-d9e9a8653acb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:53.522385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:53.524610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.526082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 372/710] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:53.528113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dff-ac3b-4ff8-bf98-90a903a4dea0 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.528113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dff-ac3b-4ff8-bf98-90a903a4dea0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.528113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375dff-ac3b-4ff8-bf98-90a903a4dea0 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.534511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 373/711] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:53.534511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375dff-ac3b-4ff8-bf98-90a903a4dea0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.543327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 339/712] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:53.546160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.546985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.547993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.568025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:53.569233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:53.570696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:53.660658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375dff-ac3b-4ff8-bf98-90a903a4dea0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.671483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 340/713] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:53.673094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.700612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.701290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.701571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.701854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.702569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:53.703296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.704964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.710439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 374/714] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:53.716295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.727159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:53.812957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c764a73-e9d4-488a-a135-c9f43a1e60c9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.840911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:53.856956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ca67f-8e41-4500-9615-f2e6aea582de None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:53.861399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.862523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.863052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.863559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.864658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:53.865191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.867050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.875015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 341/715] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:53.876440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.899279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:53.900124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:53.900402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:53.900683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] PATH_INFO: `/v3/services/network` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:53.901915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:53.903291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:53.915744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:53.916956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:53.918334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 375/716] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:53.923354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:53.994100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:54.008015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfe70f-e1f8-4ac8-b5e2-effd111a006a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.048052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.048979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.049446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.049973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.050857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:54.051318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:54.053048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14336-a1ff-4133-a2b9-c1ae23a36e43 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:54.062595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 342/717] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:54.064817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b689-8eab-4359-8562-a0506a8bdb59 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.065525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b689-8eab-4359-8562-a0506a8bdb59 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.066010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b689-8eab-4359-8562-a0506a8bdb59 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.068912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 343/718] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:54.075731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612b82-d27d-4065-bf6e-54725187306f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.076345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612b82-d27d-4065-bf6e-54725187306f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.076799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612b82-d27d-4065-bf6e-54725187306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.081699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561032a-6386-4adc-ac37-bd80b90bbd9e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.097062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-65612b82-d27d-4065-bf6e-54725187306f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:54.098525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65612b82-d27d-4065-bf6e-54725187306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:54.137074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.137935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.138328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.138707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.139573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] RBAC: Adding query filter params (name=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:54.140098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:54.141675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:54.156295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 376/719] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:14:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:54.162061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:54.185034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 344/720] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:54.204660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:54.211497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612b82-d27d-4065-bf6e-54725187306f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:54.350336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35b10-6396-4531-8d4c-1ce4f6abe470 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.357886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:54.384788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65612b82-d27d-4065-bf6e-54725187306f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.392839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.393677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.394068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.394457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.395380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:54.395813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:54.397396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:54.404719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 377/721] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:54.447146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.447146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.447146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.447146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.472845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-762729fb-6570-4507-bb03-0f8bb4daff48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:54.481771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:54.482977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:14:54.484026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:54.491912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 345/722] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:54.498294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:54.639006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:54.658641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eaab6-8116-47e5-8896-364741562ec6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.684704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb672-7981-48db-b81b-b6c3f85f633e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.685227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb672-7981-48db-b81b-b6c3f85f633e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.685305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fb672-7981-48db-b81b-b6c3f85f633e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.686810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 346/723] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:14:54.692791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.693076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.693354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.706856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.707869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.708301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.708724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.709639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:54.710109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:54.711698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:54.721623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 378/724] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:54.728104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:54.728104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:54.735051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:54.817090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 347/725] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:54.845842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:54.877708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5029f-66e8-4a23-bcba-1c8abfc23594 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:54.915076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:54.915847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:54.916231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:54.916516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:54.928509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:54.930191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:54.939822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:54.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:54.956984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:54.957882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:54.957882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:54.957882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:54.957882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:54.963381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 379/726] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:54.965610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.009063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:55.059205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d8d20-db91-4bef-b04c-ceb12230fdf8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.123502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.124308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.124590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.124864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.142528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:55.147953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda3406-8214-4c50-8c62-6b77bb198997 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:55.155079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:55.156057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:55.156893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:55.161209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 348/727] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:55.165257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.222630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.223594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.223884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.225061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.225798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:55.226110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:55.230425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:55.251216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 380/728] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:55.257261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.329301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bd090-d761-400a-ac52-debfaa39ecb3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.375738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:55.408999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.409695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.409979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.410255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.411012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:55.411316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:55.412731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:55.415709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:55.429844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 349/729] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:55.436150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.463836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783ff28-a221-46ff-b1eb-313ca85808bc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.536639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.537438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.537726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.537998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.549664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:55.551123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:55.586360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:55.588831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:55.591837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 381/730] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:55.600629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.629918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2d94-c92a-410b-9c82-10d809a30648 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.703803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.704550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.704798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.705074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.715320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdd042-6c1c-4c6b-9620-c74b85c1e766 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.730215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:55.731983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:55.739816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:55.751977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.752659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.752944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.753231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:55.754073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:55.754385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:55.755849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:55.774272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:55.775435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:55.777025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:55.777025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:55.777025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:55.777025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:55.777249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 382/731] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:55.777323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 350/732] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:55.782772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.788326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:55.890869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2fdd-6875-4312-a933-17555b715368 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:55.916041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:55.938438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:55.939109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:55.939406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:55.939689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.023434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ea11a-91ac-4217-a898-0f5a7e9fad8f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.027758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.075723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.076393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.076673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.076944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.077670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:56.077972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.079729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.083075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.084535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.109556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 351/733] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:56.116024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.263509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 383/734] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:56.264497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.353637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385e60-13e7-4b7a-9fe2-a4dbc35eb5b5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.365910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.374087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.397971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09cd45-51c0-44b3-8a54-29dcaca11286 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.435376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.436201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.436480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.436753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.438334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.439412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.439698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.439972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.452288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.453737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.456384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.457844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:56.473047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:56.474016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:56.474914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:56.474914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:56.474914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:56.474914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:56.474914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 384/735] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:14:56.481126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:56.496760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:56.497800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:56.498743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 352/736] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:56.504893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.607945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb06f5c-5685-4780-ac54-18ae2a9a8b96 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.638516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.649790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.650325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32146-3785-44a1-a890-dbe0868c19d5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.650861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.651295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.652539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.653563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:56.654059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.655680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf02b-04f3-486d-bb69-1b067915d9f1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.669350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 385/737] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:56.671346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27edb6-0ba6-484e-a53a-8c5976c02cff None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.671869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27edb6-0ba6-484e-a53a-8c5976c02cff None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.672352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27edb6-0ba6-484e-a53a-8c5976c02cff None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.678393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 386/738] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:56.679546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27edb6-0ba6-484e-a53a-8c5976c02cff None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.691842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.692886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.693178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.693456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.694622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:56.695096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.696586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1f68d-b510-4d2e-afe1-78184409b029 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.715082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 353/739] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:56.716225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323c0c-82f6-4ba8-a651-d5f5c164d048 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.716516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323c0c-82f6-4ba8-a651-d5f5c164d048 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.716795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6323c0c-82f6-4ba8-a651-d5f5c164d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.733943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d6323c0c-82f6-4ba8-a651-d5f5c164d048 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:56.735148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d6323c0c-82f6-4ba8-a651-d5f5c164d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:56.756719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.798165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27edb6-0ba6-484e-a53a-8c5976c02cff None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.814644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 354/740] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:56.816263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116f064-9770-42e2-8e42-209a029a1f0c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.816554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116f064-9770-42e2-8e42-209a029a1f0c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.816836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116f064-9770-42e2-8e42-209a029a1f0c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.822180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 355/741] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:56.822180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116f064-9770-42e2-8e42-209a029a1f0c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:56.854166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.855072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.855313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.855593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.862610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:56.864043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a59f3746-3e4a-48ae-89e9-7d78983e5f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:56.879377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:56.880334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:56.881265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 387/742] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:56.881754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.882429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.882429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.899893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:56.901165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:56.935349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116f064-9770-42e2-8e42-209a029a1f0c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:56.946974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:56.973292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98019442-4754-421f-90df-cf9978d1038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:56.973963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019442-4754-421f-90df-cf9978d1038e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:56.974245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019442-4754-421f-90df-cf9978d1038e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:56.974517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98019442-4754-421f-90df-cf9978d1038e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:56.977889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 388/743] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:56.979170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.013722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.060442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98019442-4754-421f-90df-cf9978d1038e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.061926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98019442-4754-421f-90df-cf9978d1038e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.095163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995df20e-958d-4db0-ac41-a2f0062f99de None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.131051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.131903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.132186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.132459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.143070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:14:57.150639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:57.151695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:14:57.152631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:57.155887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 389/744] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:57.157128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.175052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 356/745] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 23 15:14:57.175910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98019442-4754-421f-90df-cf9978d1038e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.199248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.232266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.264277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1e72f-d91e-4bda-aabe-b9a725b04537 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.274892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98019442-4754-421f-90df-cf9978d1038e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.297296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.297950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.298229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.298505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.299285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:57.299628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.301049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.310553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.311210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.311531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.311811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.312528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.313594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 390/746] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:57.313893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f26d47-7e96-4e79-a4f7-ccd8f1a97938 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.314383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.335742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 357/747] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:14:57 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:57.337708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97d2d-5952-4c5a-a275-7290409ea438 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.338009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97d2d-5952-4c5a-a275-7290409ea438 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.338290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f97d2d-5952-4c5a-a275-7290409ea438 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.340340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 358/748] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:57.340954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f97d2d-5952-4c5a-a275-7290409ea438 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.429089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.437736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd652e-f659-4e8e-b878-a2bccf8b61a5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.464488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f97d2d-5952-4c5a-a275-7290409ea438 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.478149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.478869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.479155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.479467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.479669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.480501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:57.480806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.482217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.492041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 391/749] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:57.492722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.513282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.514094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.514371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.514651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.526149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.529096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-79088df5-f746-4ae0-86bb-1b1cb17c5e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:57.549164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:57.550258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:57.551340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:57.551340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:57.551340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:57.551340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:57.551340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 359/750] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:57.553697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.553697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.553697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.570902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:57.572114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:57.614702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba14243-1878-4e88-8600-aadb8c8fc716 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.663393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 360/751] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 23 15:14:57.663393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.664750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.665580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.665934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.666291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.667814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=9740cc30848f47db8cc5fa655c06d763) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:57.668208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.669738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.683485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 392/752] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/role_assignments?user.id=9740cc30848f47db8cc5fa655c06d763&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:57.683485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.708985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.802918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119125ef-fd33-42b0-82f4-3933b2c92d3e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.812022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.822275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77eb4b0-1d60-4d3c-a6f7-0375d8ae00c5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:57.842497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.843181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.843517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.843799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.844602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:57.844920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.846653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.860825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:57.861639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:57.861924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:57.862201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:57.862827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 393/753] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:57.863730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.879632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:57.880238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:57.899344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:57.900299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:57.901184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:57.901184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:57.901184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:57.901184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:57.901184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 361/754] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:57.901646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:57.961607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:57.983675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09e48-b6cc-4858-bbdd-17ff3e2142ac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.030892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.032104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.032576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.033374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.034405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.035980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.054543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4198d99-5ff6-4460-8b17-6e41fd5ff611 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.063848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 394/755] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:14:57 2022] POST /identity/v3/services => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:14:58.065387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.142187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.143028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.143316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.143621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.158695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.160213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:58.187841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:58.188789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:58.189758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 362/756] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:58.195866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.200796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:58.284829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa5f9-2bbe-4902-bb2c-25ff5527d2ca None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.330197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.330874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.331168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.331463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.332579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:58.332897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.335069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.350854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 395/757] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:58.355922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.361318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:58.364930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea2f95-dbda-459b-b484-ff6d4644e4bf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.402156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.403024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.403316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.403638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.404493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:58.404812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.406374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.424112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 363/758] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:58.428101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.489084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3bc97-ead5-4430-9f19-2a521fed4fa5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.516905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:58.533848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.534651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.534993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.535218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.544288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.545731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:14:58.561234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:58.562224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:14:58.563166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 396/759] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:58.568201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.571826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32a405-1bcd-492e-ba33-5e566cbf61ff None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.624179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.625767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.626241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.626703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.627798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=7457fcf08cac43a3831a145946f12bc7) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:58.628448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.630899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.639087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:58.647153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 364/760] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/role_assignments?user.id=7457fcf08cac43a3831a145946f12bc7&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:58.721758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c7fb1-811f-4f05-85e2-dba4e73eb647 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.777866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:58.778561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:58.778846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:58.779127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:58.780012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:58.780325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:58.781781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:58.817893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 397/761] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:58.828526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:58.954566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefab7-49e7-4e31-a1a2-5c829cc0d6b3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:58.996526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:59.013290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:59.014098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.014380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.014648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.031628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:59.033101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:14:59.054501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:59.055480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:59.056378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:14:59.056378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:14:59.056378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:14:59.056378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:59.056378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 365/762] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:59.061582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:59.209270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d18f90-0c3e-4a5d-bb84-99463c875691 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:59.239431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:59.257170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:59.257844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.258129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.258409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.259141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:59.259481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:59.260849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:59.278418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 398/763] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:14:59.283828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:59.435215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab959bc4-07da-415b-92b9-31201fb24cbf None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:59.484980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:59.486147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.486628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.487095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.497546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:59.499260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:14:59.515126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:14:59.516038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:14:59.516932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:14:59.519342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 366/764] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:14:59.531039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:59.672700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3266c-fc22-4d57-8596-4e2bab354431 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:59.720186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:59.720862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.721145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.721687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.722483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:14:59.722792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:59.724289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773b5de-2a1d-4b95-bde9-d275eb3a13d7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:59.749574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 399/765] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:14:59.755188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:14:59.829548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:59.850976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97610-154c-44dc-b3f4-6c1be5ef6f64 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.851721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97610-154c-44dc-b3f4-6c1be5ef6f64 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.852217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed97610-154c-44dc-b3f4-6c1be5ef6f64 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.854026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 400/766] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:14:59.859598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.860143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.860643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.896386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:14:59.897964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:14:59.907763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c3b1-b577-4c96-9bc3-0934ea39182b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:14:59.949851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:14:59.951803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:14:59.952517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:14:59.954138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:14:59.957760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=b485e0918e744da9875e48e7906264e9, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:14:59.959659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:14:59.971732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:14:59.987855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 367/767] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:14:59 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:00.016666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 401/768] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:14:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:00.040848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.152993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:00.157369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e66baf-da49-478a-be91-2649f61ef933 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:00.195485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:00.196775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.197292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.197767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.199301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:00.201099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:00.217573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:00.218605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:00.219475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:00.222966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 368/769] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:00.229384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.351434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11d0bb-721a-4303-9282-ae04e657ff09 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:00.388524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:00.389607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.390118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.390595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.391556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:00.392065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:00.393698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bd3a1-3be2-48ad-8dc9-9b0ac447d9e3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:00.399103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 402/770] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:00.405477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.488671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e00ffa-11cb-4237-ac61-13a29998ff61 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.489003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e00ffa-11cb-4237-ac61-13a29998ff61 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.489231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e00ffa-11cb-4237-ac61-13a29998ff61 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.490862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 403/771] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:00.496086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.496480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.496764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.527631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a92f-febc-4a7c-9a98-872075b96b38 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:00.528958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:00.531392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:00.568742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:00.569778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.570263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.570763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.571712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:00.572218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:00.574119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:00.579713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 369/772] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:00.585518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.601709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:00.651863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:00.696681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68acf-5c85-4148-a768-ba39abb70142 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:00.733052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:00.734118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.734629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.735132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.736149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] RBAC: Adding query filter params (interface=public, service_id=a0808a4164bb439ca1996ba74b99ba80, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:00.736668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:00.738278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:00.747072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 370/773] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/endpoints?service_id=a0808a4164bb439ca1996ba74b99ba80&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:00.751511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 404/774] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:00.752977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.796813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:00.864326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:00.877214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301b61-4a3b-409e-9eb1-413a2ca7fd53 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:00.917644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:00.918927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:00.919466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:00.919978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:00.920963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:00.922723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9289b34-619f-42c5-b22a-1ac3b6ae7bf1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:00.929111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 371/775] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:01.022122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85428177-3f11-4c72-8b47-f63afb99cf67 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.069975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb76-3da6-4e4e-a591-3ff847c45078 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.070627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb76-3da6-4e4e-a591-3ff847c45078 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.071110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbfb76-3da6-4e4e-a591-3ff847c45078 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.073024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 372/776] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:01.076719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.077851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.078294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.078569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.078673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.078844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.079315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.103899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:01.117898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:01.119557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:01.123695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:01.124706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:15:01.125570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:01.135935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 405/777] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:15:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:01.137210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.187727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:01.227167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 373/778] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:01.253294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.329895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490c7b7-171d-47a5-9270-ed6137ce1463 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.355766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:01.368787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3de31-e5e9-4f57-bf68-557933312ad7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.394829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.395915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.398111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.398624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.399612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:01.401895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.404419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:01.425065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 406/779] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:01.430782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.445316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.446511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.447016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.447547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.448947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.453454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d010bc24-476d-4485-a90a-8a7ed135e5f4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:01.476217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:01.477308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:01.478130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:01.482656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 374/780] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:01.488857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f653-e644-470b-a8d3-f0a4896097e8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.488857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f653-e644-470b-a8d3-f0a4896097e8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.488857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f653-e644-470b-a8d3-f0a4896097e8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.490503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 375/781] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:01.491094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f653-e644-470b-a8d3-f0a4896097e8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.567127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:01.587311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ece3b-6eb1-4132-911f-1c51e74861b8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.620008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f653-e644-470b-a8d3-f0a4896097e8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.633627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.634846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.635466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.636485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.650650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.652936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:01.663109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.664379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.664730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.665131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.666142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:01.666532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.669103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29418169-b411-497e-95b5-6dcffdcc08ba None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:01.679286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 376/782] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:01.679286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.679286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.679286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:01.681291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:01.682137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:01.683355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:01.683355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:01.683355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:01.683355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:01.685633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 407/783] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:01.686304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.702829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:01.704632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:01.716092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:01.803569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 377/784] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:01.804786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.838186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b189b-fac2-45fa-8133-972d42945a50 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.889649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.890986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.891529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.892223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.893808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] RBAC: Adding query filter params (type=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:01.894320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.896971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:01.905082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 408/785] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:01.906358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:01.910237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:01.941166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b771e-093a-4fd0-ae5e-e081c1681055 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:01.988395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:01.989645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:01.990158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:01.991202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:01.992438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:01.992949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:01.995834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.011504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 378/786] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:02.012649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.016275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.028502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f060d-1704-4707-95a3-2c695d333650 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.065001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.065805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.066093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.066370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.077476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:02.085409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:02.086357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:02.087212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 409/787] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:02.087941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.146564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e905b-4002-44ec-b423-4d2ed6296930 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.171054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.185420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.186123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.186407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.186686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.187518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] RBAC: Adding query filter params (interface=public, service_id=ce118db705644bbbba1fc75381a82090, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:02.187836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.189219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.195711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 379/788] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/endpoints?service_id=ce118db705644bbbba1fc75381a82090&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:02.196546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.218040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d35a63-97d7-40c7-a809-b8f393095c9d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.263342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.264891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.265590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.266082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.277237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.277781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.279613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:02.299965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:02.301129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:02.302181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:02.302711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 410/789] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:02.303658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.327802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298c42c-c566-42ff-9b24-9754e17a8863 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.387030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.387754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.388324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.388605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.389359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:02.389832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.392041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.407194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 380/790] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:02.408043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.433159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25dc85-19ea-4937-82f3-03206682ad54 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.461299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.481864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.483268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.483754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.484484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.485336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.487562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.499170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 411/791] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:02.501328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.613960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95426a-f182-4752-9e3c-06f854d0a62c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.691728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d78ce-5e64-4bbc-bb92-bba49e80ddd4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.719794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.731016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.731753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.732036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.732307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.733160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:02.733468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.738196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.777145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.777955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.778509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.778793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:02.787530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 381/792] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:02.803907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.806375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:02.810688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:02.837063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:02.838267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:02.839694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:02.839694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:02.839694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:02.839694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:02.839694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 412/793] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:02.846787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:02.906650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:02.941206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864777-8bb3-49e8-b944-0aca34e31ac1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:02.986433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:02.987524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:02.987958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:02.988379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.000719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.002013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1d656-6898-4401-aed7-57d58957ef5f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.002640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9523698c-5c45-4e61-a02b-caf46758c219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:03.022392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:03.023588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:03.024671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:03.024671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:03.024671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:03.024671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:03.026685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 382/794] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:03.028443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67171-f1ce-4109-9b67-1cb8e4101b92 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.028892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67171-f1ce-4109-9b67-1cb8e4101b92 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.029313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c67171-f1ce-4109-9b67-1cb8e4101b92 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.031092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 383/795] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:03.037839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c67171-f1ce-4109-9b67-1cb8e4101b92 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.046630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.047308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.047618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.047893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.048731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:03.049345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.050990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a988-1788-4aa0-9fd8-a4a3cd7d8319 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.070202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 413/796] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:03.071985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.072479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.072811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.090686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.091346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:03.092682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:03.167701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c67171-f1ce-4109-9b67-1cb8e4101b92 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.179922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 414/797] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:03.180731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.214847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.216917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.217602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.217961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.218126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.218874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:03.219182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.221092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.239626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 384/798] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:03.240794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.318243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4ead5-97ee-4bb1-b53b-a618faa381b4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.365544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.366378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.366631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.366909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.375716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.377432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.383530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.389211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b8d68-ecbb-49e1-8f6a-0686160fec26 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:03.394827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:03.395824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:15:03.396771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:03.403709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 415/799] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:03.404921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.440755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.442244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.442717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.443178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.458477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:03.469594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:03.471012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:03.472096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:03.475384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 385/800] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:03.476344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.507181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.523664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa52f4-b31e-4e1a-9a63-61f3ace37e3c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.564567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.565833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.566294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.566736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.577674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.580325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.602899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81911c8-20f1-453e-8535-4cf3e1bdd72c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:03.603083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:03.604845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:03.605789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 416/801] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:03.606808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.644018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.644694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.644973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.645249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.646079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:03.646384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.647853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db6fa9-9051-4a84-b29a-2cb8ebbe31ba None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.667972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 386/802] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:03.669547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d7c3-53cb-4306-9f4a-e7572e1a9118 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.669836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d7c3-53cb-4306-9f4a-e7572e1a9118 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.670114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704d7c3-53cb-4306-9f4a-e7572e1a9118 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.672461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 387/803] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:03.673391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d7c3-53cb-4306-9f4a-e7572e1a9118 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.695844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.720421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d269b-8e31-4295-96f5-becef949f830 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.757647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.757647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.757921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.758151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.758893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:03.759199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.761189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.774759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 417/804] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:03.775695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.789545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.791299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704d7c3-53cb-4306-9f4a-e7572e1a9118 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.835338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.836052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.836338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.836620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.837414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:03.838265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.839882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581fbbe-05c9-4a31-a5bd-5a01b99456c2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.858536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 388/805] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:03.858536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.858536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.858536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.879611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:03.880954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:03.907810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f6e2d-2866-48e6-b7e3-d3917c080d8e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:03.947994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:03.949274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:03.949710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:03.950127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:03.959426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 389/806] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:03.959426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:03.972992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:03.974404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:03.976463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:03.996402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:03.997363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:03.998228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:03.998228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:03.998228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:03.998228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:03.998228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 418/807] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:03.998510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.066790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.078733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900e84e-da30-41ef-9f86-bbca37f42319 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.111545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ded27-6da5-4c7c-b3f3-d6cfbcd10e7d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.116546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.117340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.117623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.117893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.132139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.133590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.149453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.150351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.150641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.151500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/9740cc30848f47db8cc5fa655c06d763/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:04.151832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:04.152766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:04.153652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:04.153652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:04.153652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:04.153652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:04.153652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 390/808] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:04.153924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.171057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=9740cc30848f47db8cc5fa655c06d763, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.172533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.187449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 419/809] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:03 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/9740cc30848f47db8cc5fa655c06d763/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:04.188859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.256120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.274703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f0817-e0db-4f22-bccb-4c7c245c1112 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.323333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.324098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.324382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.324657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.325330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.326791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.349400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8060f6-e6fa-44c8-8b79-191c75abb495 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:04.350324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:04.351243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 23 15:15:04.352152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:04.353719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 391/810] 10.222.0.46 () {56 vars in 1129 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:04.354160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.368465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.397928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.398662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.398952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.399260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.400165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:04.400475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.401903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.416033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 420/811] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:04.417198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.490751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5801bf-f82b-4111-8da0-436d5f64feb7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.521113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.529870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8e34-b7eb-4bce-9c0a-e3d5e5a44032 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.536738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.537684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.538240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.538711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.539838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:04.540342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.542069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.556401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 392/812] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:04.557653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.566238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.566916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.567202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.567509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.568504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:04.568504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.569877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.575203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 421/813] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:04.580551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.618151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.680913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0d4d-93a9-44e9-97c2-090683b09d06 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.686190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fbbb9-314f-433a-9797-42edffcd5f26 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.721989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.722814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.723428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.723657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.723918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.724195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.724544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.725042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.732668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.734110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.734982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.736838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:04.748749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:04.749723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:04.750672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 422/814] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:04.751250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:04.755385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:04.756250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:04.757124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:04.763712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 393/815] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:04.765006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.839207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.889096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:04.897906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821909f2-5536-43a7-a385-2faacb04c7e9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.918076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0e79-ea99-49ce-a15f-afc686e28aa6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:04.942391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.944176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.944887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.945316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.946450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:04.947303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.949971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.962060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 423/816] 10.222.0.46 () {56 vars in 1124 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:04.962060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:04.963628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:04.964318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:04.964605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:04.964884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:04.965732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:04.966044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:04.968652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:04.991441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 394/817] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:04.992614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.078104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d87aa-77f9-4edd-b8b5-e1ef702a6cd1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.100286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.103196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4c1e7-db42-4f06-86b1-57189d9fef48 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.115599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.116262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.116636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.116887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.117604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:05.117915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.119548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.137016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 424/818] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:05.137016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.146194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.146858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.147145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.147498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.148216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.149586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975511-19dc-445d-a182-7dddef8fe94d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.157865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 395/819] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474dbbf-d25c-48f5-9a56-61bf65aac26a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474dbbf-d25c-48f5-9a56-61bf65aac26a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474dbbf-d25c-48f5-9a56-61bf65aac26a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 396/820] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:05.179407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474dbbf-d25c-48f5-9a56-61bf65aac26a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.256886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120e203-574b-46b7-870b-d288ca03f55a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.318045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.318967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.319106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474dbbf-d25c-48f5-9a56-61bf65aac26a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.319353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.319739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.370166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.371615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.371979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.372331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/7457fcf08cac43a3831a145946f12bc7/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.374554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=7457fcf08cac43a3831a145946f12bc7, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.376443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ebecf-373d-41f6-b7a3-be89fd55747c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.398671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 397/821] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:05 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/7457fcf08cac43a3831a145946f12bc7/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:05.403514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.403514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.403514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.428216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:05.429556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.429759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:05.431144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.440146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.456892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.521107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 398/822] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:05.565392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.590353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 425/823] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:05.596869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.719127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095efcc3-f59c-4d9a-b140-d86da9a64d5a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.746236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea5d60-9de6-49a1-b6d1-f8f232627a62 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.767392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.767392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.767392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.767392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.767799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.767799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.778453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:05.779255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:05.780416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:05.781252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 399/824] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:05.792638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.801963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:05.803192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.804485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.805108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.805612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.834905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.836432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:05.872539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:05.873583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:05.874749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:05.874749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:05.874749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:05.874749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:05.874749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 426/825] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:05.879694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:05.914986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd64e4c-4ccd-48fb-a20c-8e7c6882ead2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:05.952982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:05.953959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:05.954423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:05.954873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:05.955794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] RBAC: Adding query filter params (name=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:05.956306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:05.957862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:05.963518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 400/826] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:05.968485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.045669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:06.082796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6855d-ebda-4e7f-973e-47804ef2320a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.111483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269eb046-4d5c-4f0d-b5b4-07a4ee9fb466 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.145233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.145907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.146187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.146463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.147190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:06.147523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.148896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.173771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 427/827] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:06.177396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.178066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.178350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.179732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.180281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.181001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] RBAC: Adding query filter params (type=network) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:06.181311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.185216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.194083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 401/828] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:06.199485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.238819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:06.363713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6503-9a37-43dc-a17e-f3e60a10b039 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.367851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9a8a-48ed-4641-ba9d-6227f9ed02ad None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.406353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.407161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.407532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.407875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.408690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.413370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.413846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:06.433183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 402/829] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:06.458162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.458989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.459273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.459568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.471745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.473237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-19502cd2-60ce-459f-9c68-9810877bbc81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:06.490344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:06.491294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:06.492831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 428/830] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:06.497581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.609651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4d22-2ef7-4503-942c-da97459391c9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.609989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4d22-2ef7-4503-942c-da97459391c9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.610203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4d22-2ef7-4503-942c-da97459391c9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.611795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 429/831] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:06.618712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.618996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.619772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.622038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a64faf-57c8-4c0e-9ab4-8778e6527b26 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.651485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:06.652703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:06.658508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.659174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.659486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.659767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.660553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:06.660922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.662517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.675914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 403/832] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:06.683896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.737512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 430/833] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:06.743807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:06.762908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:06.779761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:06.795273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c248-e439-46a1-bd49-cd93e251c3af None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.833329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.833994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.834276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.834549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.835498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:06.835813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:06.837360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:06.845265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 404/834] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:06 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:06.881226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8476ff-3cb1-4c4b-8053-4f7775d1bd3f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:06.920995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:06.921841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:06.922134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:06.922421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:06.936000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:06.944034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:06.945038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:06.946184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 431/835] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:06.953362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.076594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f995284-23b5-42f0-acb1-d52741797b42 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.093200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:07.116296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.117295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.117805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.118288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:07.119288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:07.119826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:07.121443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:07.132465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 405/836] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:07.136006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.218707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:07.245307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf9ad-1ffc-404c-a5c2-048b57be1249 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.279539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.280342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.280632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.280910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:07.292126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:07.293584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:07.311190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:07.312122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:07.313018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:07.313018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:07.313018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:07.313018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:07.317051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 432/837] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:07.318403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.428387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae6a7d-c9ad-4fff-8df6-02ae5eca0432 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.464571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.465615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.466097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.466567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:07.467591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:07.468109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:07.469687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:07.483081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 406/838] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:07.491282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.598717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd5ffe-3e53-461f-96a0-9dbf7256658c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.627058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:07.636672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.637499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.637795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.638082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:07.646154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:07.647632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:07.662737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:07.663738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:07.664667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 433/839] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:15:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:07.670791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.708128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:07.780881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e73a4-e108-455c-8388-e011a436936e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.816815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.817496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.817781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.818061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:07.818906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:07.819217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:07.820714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3745a4c-d06c-4ea1-8154-eb587a84f9cf None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:07.842488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 407/840] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:15:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:07.848352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:07.961567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de360e71-9420-489b-9aa2-684b8dd434eb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:07.997838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:07.998544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:07.998828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:07.999102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.050912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b648d-ae38-45c4-be24-03a4c98ecde3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.051220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b648d-ae38-45c4-be24-03a4c98ecde3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.051513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b648d-ae38-45c4-be24-03a4c98ecde3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.057134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 408/841] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:08.057981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.058347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5629c2-fca4-4e65-a5b3-16128ac65390 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.058638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5629c2-fca4-4e65-a5b3-16128ac65390 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.058917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5629c2-fca4-4e65-a5b3-16128ac65390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.073003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.074454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.077822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6d5629c2-fca4-4e65-a5b3-16128ac65390 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:08.079010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d5629c2-fca4-4e65-a5b3-16128ac65390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 409/842] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263289-1659-49c7-8cd2-b3937a5e4cef None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263289-1659-49c7-8cd2-b3937a5e4cef None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263289-1659-49c7-8cd2-b3937a5e4cef None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 410/843] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.163384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.163929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.183299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:08.184529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:08.191547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 434/844] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:08.192339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.208623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.266355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 411/845] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:08.267530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.297574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.314718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108173c-42d4-4ae8-92e7-8f9aee13da40 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.352299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.353684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.353967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.354279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.355083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.356492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:08.369351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:08.375411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:08.376463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 435/846] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:08.377428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.383110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d6bc7-435d-4cb5-ae25-b531a01a35d6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.420050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.420849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.421136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.421412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.431655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.433122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:08.451844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:08.452789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 412/847] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:08.458277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.471294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.494489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea28fe-878a-4782-a5c2-112c01056b9b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.530614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.531344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.531661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.531940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.543831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:08.552189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:08.553163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:08.554054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 436/848] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:08.554785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.568092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.576867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bb86d-bd63-401a-8462-6e93bbb0fc96 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.615503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.616175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.616457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.616730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.617444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:08.617748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.619738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.624638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 413/849] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:08.625499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.671787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea4849-ee43-448b-8de4-35875377d2ae None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.697836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.713221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.714171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.714480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.714911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.715966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:08.716286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.717658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.734800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 437/850] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:08.734800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.735075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af807e-6ea8-4801-8d20-259c0e6ca3de None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.772934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.773609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.774383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.774664 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.775606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:08.776426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.778138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.787545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 414/851] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:08.788300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.810678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.849116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea96-0ee6-422f-9e66-ca836cc1ffa3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.884662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.885344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.885633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.885916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.886635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:08.886939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.888351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:08.892997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 438/852] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:08.893877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:08.926943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad53e-0e7a-47ef-b58e-03c5d1c68614 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:08.968257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:08.975920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:08.977064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:08.977364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:08.977652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:08.989175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:08.991147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:09.009903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:09.010904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:09.011820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 415/853] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:09.018492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.026627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59682-78e5-498e-ac1b-fa9432cfca8d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.068448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.069342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.069734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.070143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.073397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.085162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.086853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:09.110229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:09.111385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:09.112307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:09.112307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:09.112307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:09.112307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:09.112553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 439/854] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:09.117769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.156622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f01212-f314-49ad-aa35-dda5fff064a1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.214765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.215486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.215783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.216064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.216973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:09.217290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.218743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.232927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 416/855] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:09.238585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.243539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdb53b-8f3c-4b56-a916-35150d7d9b95 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.282656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.283501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.283881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.284253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.285235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:09.285637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.287200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.301722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 440/856] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:09.308038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.309109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.362097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.367813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951654b-be87-4f4b-b1e5-b9a7ac71877b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.406029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.406692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.406976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.407253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.408120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=9740cc30848f47db8cc5fa655c06d763) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:09.408432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.409886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb696cf1-76ee-412a-bb73-dc92f8dc8eee None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 417/857] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/role_assignments?user.id=9740cc30848f47db8cc5fa655c06d763&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd847-455c-4355-881b-9bdaff0ff846 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd847-455c-4355-881b-9bdaff0ff846 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd847-455c-4355-881b-9bdaff0ff846 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 418/858] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:09.427393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.428011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.428011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.428181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d6a76-6605-4d92-9936-5fc867e8f5da None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.448783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:09.450687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:09.477117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.478629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.479073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.479377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.492241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.495732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:09.512449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:09.513710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 23 15:15:09.514905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:09.515599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 441/859] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:09.521180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.555044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 419/860] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:09.584126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.651236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.659121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22aeef-b46b-40bc-9fc9-42ad6df97e5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.667339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.701479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.702248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.702597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.702936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.703891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:09.704868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.705842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.727420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835fc1-dced-4619-b5f3-fb32b76d730e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.731399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 442/861] 10.222.0.46 () {56 vars in 1135 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:09.736712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.768577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.769391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.769672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.769971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.770592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.772287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:09.784779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:09.785901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:09.786760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 420/862] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:09.793484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.873392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d5bb-5a0f-4306-92f7-514fcde357bc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.910463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.911515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.912001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.912535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.914989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992a96-64f5-4b2c-b34a-ee721713bf2f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:09.930031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.949566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:09.959414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:09.960190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:09.960482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:09.960760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:09.961480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:09.961791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.963330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:09.968625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 421/863] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:09.975481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:09.993664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:09.995408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.098601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4495e31-05c4-469a-b333-1c1aa370ff5f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:10.132635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 443/864] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:10.133643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:10.142444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:10.143340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:10.143822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:10.144636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:10.145922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:10.146395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:10.148471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.164116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 422/865] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:10.210343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:10.255064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b25c73-7ddd-4d97-8bbe-458cd5e99f85 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:10.294174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:10.294986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:10.295267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:10.295569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:10.307976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:10.309448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:10.334264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:10.335230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:10.336153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:10.336153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:10.336153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:10.336153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:10.339609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 444/866] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:10.345264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:10.391107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:10.460316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f080-b6ec-4bc6-a141-b8611fd7ba91 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:10.496847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:10.497572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:10.497857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:10.498291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:10.499263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:10.499605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:10.500993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.514371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 423/867] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:10.519894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:10.629311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba32a8-79f9-4e84-811e-ebab0adb6ecd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:10.647715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:10.673430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:10.674516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:10.675009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:10.675494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:10.682854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:10.684568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:10.699475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:10.700408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:10.701324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:10.703715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 445/868] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:10.711481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:10.814973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:10.819066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987e160-3cf6-4b8e-90e6-5743f59920bc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:10.857873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:10.858541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:10.858823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:10.859098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:10.859929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:10.860238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:10.861674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df8cd0-b30a-4651-bcc6-9980a8b3dafd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:10.874782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 424/869] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:10.880305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:10.987427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84d485-b78c-4016-af53-c0a57bcb2c53 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:11.023158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:11.023854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.024135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.024952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.026171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=7457fcf08cac43a3831a145946f12bc7) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:11.026484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:11.027939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37886a-ee82-4aa2-8a01-6133e78babe9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:11.034452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 446/870] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:10 2022] GET /identity/v3/role_assignments?user.id=7457fcf08cac43a3831a145946f12bc7&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:11.303764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918671-b1e1-4c4c-a2ad-46076ad609bd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.304600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918671-b1e1-4c4c-a2ad-46076ad609bd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.305024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8918671-b1e1-4c4c-a2ad-46076ad609bd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.307150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 425/871] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:11.312732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82e96-e434-4623-8bf1-2cd941a948bf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.313145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82e96-e434-4623-8bf1-2cd941a948bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.313322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c82e96-e434-4623-8bf1-2cd941a948bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.334053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e3c82e96-e434-4623-8bf1-2cd941a948bf None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:11.335233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e3c82e96-e434-4623-8bf1-2cd941a948bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:11.372530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:11.410705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 447/872] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:11.433808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918671-b1e1-4c4c-a2ad-46076ad609bd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:11.544907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8918671-b1e1-4c4c-a2ad-46076ad609bd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:11.581849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:11.582436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.582724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.583000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.583857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:11.585236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52204b33-76c4-4444-b042-78c015f2cc71 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:11.600117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 426/873] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:11 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:11.873365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7efef-8fea-464b-8b03-8755f65dc703 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.873612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7efef-8fea-464b-8b03-8755f65dc703 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.873852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7efef-8fea-464b-8b03-8755f65dc703 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.875468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 448/874] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:11.880905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:11.881194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:11.881474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:11.898916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:11.900717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:11.915551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:11.981510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 427/875] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:12.004585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7efef-8fea-464b-8b03-8755f65dc703 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.116372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7efef-8fea-464b-8b03-8755f65dc703 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.153102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.153833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.154115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.154393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.166328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:12.174831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:12.175816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:12.176659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 449/876] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:12.182150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.291302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fb54e-140f-4cc4-b703-4da81186261f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.327473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.328985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.329472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.329943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.330908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:12.331539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:12.333201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:12.344910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 428/877] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:12.351694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.384626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:12.457218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c74ef-be9d-4ae5-a28c-aeb7724ebec6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.491999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.493386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.493799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.494075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.504526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:12.505976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1c1aee4c-d90e-4782-b7fe-f55ec5ef5cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:12.525635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:12.526581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:12.527512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:12.527512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:12.527512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:12.527512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:12.527512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 450/878] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:12.532721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.542608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:12.573653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb12a1-e094-42a0-931c-365f8b22131b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.573957 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb12a1-e094-42a0-931c-365f8b22131b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.574222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb12a1-e094-42a0-931c-365f8b22131b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.575871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 451/879] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:12.580894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.581138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.581405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.604984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:12.606468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:12.673617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100344f0-205b-4c9a-a472-1c7b92ff321a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.686234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 452/880] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:12.713961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.719789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.720690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.721256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.721762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.722698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:12.723198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:12.724986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:12.730560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:12.740085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 429/881] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:12.746699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:12.832671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:12.844971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5c71f-9f04-4e6b-8d17-59a718d8f609 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.880828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9af964-622e-4634-ad33-f1388be56e7f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:12.892772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.893554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.894345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.894692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.895959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:12.897667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:12.916715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 453/882] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:12 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:12.945695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:12.947007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:12.947509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:12.947950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:12.957203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:12.959213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:12.978558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:12.979861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:12.981064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:12.983706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 430/883] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:12.992454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.071979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.109812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232a4d6-55e4-4815-8309-434325919f42 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.145405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.146085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.146368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.146645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.147519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:13.147836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.149881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38509e1f-a4a2-48a9-a5cb-e93d4c72b554 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.171024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 454/884] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:13.176853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.291316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56bd17-c744-4893-8cfa-3bf7808917c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.316197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.334350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.335113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.335282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.335588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.365976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654821-af54-40ce-b268-2ab50cd0fb72 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.366596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654821-af54-40ce-b268-2ab50cd0fb72 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.367007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654821-af54-40ce-b268-2ab50cd0fb72 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.370119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 455/885] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:13.376070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.376465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.376845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.396059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:13.397474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:13.413676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.415477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.475026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 456/886] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:13.498518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.539994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 431/887] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:13.545670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.564933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.571608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.611501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5250933-3110-4005-b81a-9aa39f5b986b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.648038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.648952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.649724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.650004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.650670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.652079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.657342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c9de4-6b01-4cd3-be20-a58063875b9a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:13.664754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:13.667084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:13.669140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:13.671201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 457/888] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:13.675438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.694091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.694890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.695170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.695471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.707122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.708766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:13.728348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:13.730453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:13.732650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:13.732650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:13.732650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:13.732650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:13.735998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 432/889] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:13.735998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.783549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c925d01-9be1-4fd5-801e-c582eee535d2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.808928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.818668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:13.822039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.822786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.823077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.823386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.824479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:13.824798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.826431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.836567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 458/890] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:13.837699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.853622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab3edf-5927-4656-9ee1-0629b17edda3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.894776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.895717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.896170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.896584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.897441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:13.897885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.899751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:13.916900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 433/891] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:13.918315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:13.951231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f102-3d3e-4493-adce-2b099d410ad1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:13.988795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:13.990368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:13.990522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:13.990930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:13.992333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:13.993446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:13.996220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143cde-1b42-43ed-b382-8d63e5a977b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.011501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 459/892] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:14.033160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36062394-30e3-47d2-aa54-cd2e9b642688 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.040941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d47b-d1cb-42e0-92d4-fe82216522d1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.041230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d47b-d1cb-42e0-92d4-fe82216522d1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.041515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d47b-d1cb-42e0-92d4-fe82216522d1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.043452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 460/893] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:14.049184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.049472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.049759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.068901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:14.070059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:14.077333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.078396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.078817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.079226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.081618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.089643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.091382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:14.107961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:14.109107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:14.110174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:14.117006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 434/894] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:14.119547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.129839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.163782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 461/895] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:14.179535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.245091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c954-ae74-473e-bc91-cce46ee12f73 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.292127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.293037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.293697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.294051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.295199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:14.295599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.297128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.297624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03047dfb-736a-4b54-9220-a9e76c2b5b81 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.315520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 435/896] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:14.319123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.344110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.345337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.345909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.346431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.347335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.348972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:14.362053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:14.363059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:14.363917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:14.366819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 462/897] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:14.372925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.382824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.441451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.443455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce3a5-2c57-4496-8bda-c9ce31146c23 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.485695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.486719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.487200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.487693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.488904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] RBAC: Adding query filter params (role.id=00ca4f9d2ea94a1c994e042f537d1f13, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=9740cc30848f47db8cc5fa655c06d763) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:14.489412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.491054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.504155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 436/898] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/role_assignments?user.id=9740cc30848f47db8cc5fa655c06d763&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=00ca4f9d2ea94a1c994e042f537d1f13 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:14.504538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bde00c-04b7-4678-b8de-1afd16ce4f67 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.547083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.547818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.548109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.548392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.549129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:14.549443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.550830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.557420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 463/899] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:14.563218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.677341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef6c63-2d50-4ea1-bb21-8d28c00a1b1d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.697677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.716935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.717602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.717889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.718167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.719149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:14.719490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.720907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.728567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 437/900] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:14.733165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:14.843219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a5f64-0da2-408b-9193-809b867031b9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:14.855723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:14.880117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:14.880846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:14.881134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:14.881467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:14.882276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] RBAC: Adding query filter params (interface=public, service_id=0e9baa5653a14868b5e73b701f976ad0, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:14.882595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:14.884079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec09d85-c984-49e6-aaa1-cb91ed2a1ddb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:14.892451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 464/901] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/endpoints?service_id=0e9baa5653a14868b5e73b701f976ad0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:14.898018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:15.009072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262b9ab-dab6-44f0-882e-af110f4f9380 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:15.045332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:15.046002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.046285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.046559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.047245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:15.048654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889444f-1050-4a2e-9ce5-9a6aa27b2f58 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:15.054922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 438/902] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:14 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:15:15.276994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b8a7-0bad-47a3-be0c-114c767bdc08 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.277291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b8a7-0bad-47a3-be0c-114c767bdc08 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.277489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9b8a7-0bad-47a3-be0c-114c767bdc08 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.279108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 465/903] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:15.284684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.284975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.285257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.303700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:15.305705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:15.355255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:15.384424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 439/904] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:15.407667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b8a7-0bad-47a3-be0c-114c767bdc08 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:15.514387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9b8a7-0bad-47a3-be0c-114c767bdc08 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:15.548997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:15.549791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.550078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.550355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.551014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:15.552471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:15.565614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:15.566546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:15.567808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 466/905] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 15:15:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:15.573450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:15.689896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a42a-3f04-42da-b0aa-8f1d99445b8c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:15.735491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:15.736342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.736689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.737046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.737919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:15.738297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:15.740021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:15.746598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 440/906] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:15.751865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:15.799828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:15.872466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4fc4a5-670a-4c1d-88ff-faf29e0f6d01 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:15.908758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:15.909433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:15.909722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:15.910007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:15.910721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:15.911039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:15.912595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:15.918293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 467/907] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:15.923772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:15.971937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:16.079810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b66d-4f33-4245-938d-2ca1a0001758 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:16.123045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:16.124291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:16.124887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:16.125475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:16.126714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] RBAC: Adding query filter params (interface=public, service_id=4f0aa7a36b0341a19ff0afa480f0ca30, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:16.127389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:16.129559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c38819-d371-46c1-b6ac-0c26a7906ec5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:16.137086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 441/908] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:15 2022] GET /identity/v3/endpoints?service_id=4f0aa7a36b0341a19ff0afa480f0ca30&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:16.142240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:16.330606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00acd-5da1-455c-b904-94044e155a04 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:16.332531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:16.378080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:16.378775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:16.379066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:16.379401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:16.379592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4177-a6cd-4a3b-977b-fd465351a397 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:16.379893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4177-a6cd-4a3b-977b-fd465351a397 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:16.380109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:16.380204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d4177-a6cd-4a3b-977b-fd465351a397 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:16.381457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:16.381595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 442/909] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:16.389149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 468/910] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:16 2022] GET /identity/v3/services => generated 1268 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:15:16.394209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f359-c4c2-4dca-a2b0-69d68aab7161 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:16.395311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f359-c4c2-4dca-a2b0-69d68aab7161 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:16.396028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1f359-c4c2-4dca-a2b0-69d68aab7161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:16.449194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dcd1f359-c4c2-4dca-a2b0-69d68aab7161 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:16.451967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dcd1f359-c4c2-4dca-a2b0-69d68aab7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:16.612069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 443/911] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:16.643895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:16.754694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcea0b-6b07-4f2a-b123-0da3586d4039 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:16.790125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:16.790793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:16.791079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:16.791382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:16.792133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:16.793495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3ed32-6b66-4786-a879-09f70b32899c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:16.809384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 469/912] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:16 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:17.047778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4204-badd-4791-858a-6229fde2b670 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.048105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4204-badd-4791-858a-6229fde2b670 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.048387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd4204-badd-4791-858a-6229fde2b670 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.050059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 444/913] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:17.055520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.055932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.056321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.074196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:17.075560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:17.098106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:17.154676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 470/914] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:17.177603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4204-badd-4791-858a-6229fde2b670 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.216530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:17.294966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd4204-badd-4791-858a-6229fde2b670 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:17.334343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:17.335538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.336785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.337400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.355862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:17.364907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:17.365936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:17.366775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:17.370400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 445/915] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:17.380897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.486259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80f9cc-2607-4d6b-b380-93e69b002b9c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:17.522785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:17.524040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.524328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.524708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.525469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:17.525777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:17.527153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480967-e0a3-480e-8204-29ae14d9ff86 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:17.539484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 471/916] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:17.542153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.609659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bd9fb-bb6d-4ca9-a3fd-b831ca2cb81c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.609959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bd9fb-bb6d-4ca9-a3fd-b831ca2cb81c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.610146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bd9fb-bb6d-4ca9-a3fd-b831ca2cb81c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.612525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 472/917] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:17.620921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.621214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.621499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.643555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:17.645361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:17.658650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:17.659795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:17.670216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280531-0fe0-4dcb-b1ec-16c712a09b16 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:17.717963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:17.721024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.721527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.722146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.740205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:17.742475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:17.747447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 473/918] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:17.767684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:17.768655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:17.769576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:17.769576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:17.769576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:17.769576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:17.769808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.772979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 446/919] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:17.779454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.884036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a0bf0-3dec-401d-92f7-fca4bdd18857 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:17.889678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bef7db-be95-4dc1-996d-e133b7b0e121 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:17.921992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:17.923061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.923635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.924083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.925036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:17.926712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:17.927012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:17.927812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:17.928247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:17.928626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:17.930189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:17.930600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:17.932237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:17.941732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:17.942941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 23 15:15:17.943902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:17.947586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 474/920] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:17.951442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 447/921] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:17.952843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.957877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:17.966685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:17.969765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.080075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c43f-bdce-4c71-a8e0-db41506dbc99 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.090163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4199-65b8-4966-9bfd-4f47c7ae323a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.117292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.118509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.118866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.119219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.128519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.130090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.133818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.134762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.135230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.135732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.136621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:18.137108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.138663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.144400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 448/922] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:18.151246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:18.152193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:18.153148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:18.154781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 475/923] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:15:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:18.155938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.158316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.228229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.235987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.266897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6ffe3-a288-456c-989e-63a6e1ac328d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.272343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7b9e5-9824-4326-9b29-c032212388c1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.303156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.303702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.303993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.304329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.305746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:18.306059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.307715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.313624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.314587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.315115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.315661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.316671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:18.317216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.318908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.329475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 449/925] 10.222.0.46 () {56 vars in 1114 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:18.330621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.331292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 476/925] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:18.332602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.444246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ca040-80bf-4265-b794-a519fdb67189 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.444946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc83c6-b92d-4688-a95d-e7f2c0379e6f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.474324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.486774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.487222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.487614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.487993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.490858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.491811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.492319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.492795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.493742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.495487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.498900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.499449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.501890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:18.523540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:18.524929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:18.525836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:18.525836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:18.525836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:18.525836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:18.526057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 450/926] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:18.526140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 477/927] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:18.531296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.672448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aceb0d-7fd6-4019-ba99-552e10e2c563 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.711951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.712751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.713040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.713318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.714126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:18.714442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.715897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e579-4689-413a-8ed6-66a2889f1670 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.730015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 451/928] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:18.735553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.838581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164331a-d228-4f13-8ea0-2b7830edfe58 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.838872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164331a-d228-4f13-8ea0-2b7830edfe58 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.839153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164331a-d228-4f13-8ea0-2b7830edfe58 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.841871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 452/929] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:18.846119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.846408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.846689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.865474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08dbe8-cd10-4fc7-9c36-c9b008eef7ce None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:18.868867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:18.870086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:18.906425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:18.907235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:18.907556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:18.907841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:18.916961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:18.919054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:18.920338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:18.941575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:18.942530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:18.943694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 478/930] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:18.949416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:18.963661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 453/931] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:18.982385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.000311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.063817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642168f-9682-42fa-9050-3d172c701843 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.099706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.100525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.100904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.101393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.102419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:19.102764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.104382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.105718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62c64-7ffe-4ca5-b8c4-65bc8ad33263 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.117336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 479/932] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:19.122946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.155650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.156936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.157226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.157505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.158326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.159870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-055192f5-d369-419b-bde1-75040beb4ef9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:19.173213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:19.174204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 23 15:15:19.175029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:19.179572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 454/933] 10.222.0.46 () {56 vars in 1132 bytes} [Mon May 23 15:15:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:19.180784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1cd6-f4c4-4e71-b99e-361460e5efc5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.181072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1cd6-f4c4-4e71-b99e-361460e5efc5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.181356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1cd6-f4c4-4e71-b99e-361460e5efc5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.183402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 455/934] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:19.184546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1cd6-f4c4-4e71-b99e-361460e5efc5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.230732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.235053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.237892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89082c41-be99-47da-bc8a-ef36d49c9472 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.274527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.275968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.276185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.276464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/9740cc30848f47db8cc5fa655c06d763/roles/00ca4f9d2ea94a1c994e042f537d1f13` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.278762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=9740cc30848f47db8cc5fa655c06d763, role_id=00ca4f9d2ea94a1c994e042f537d1f13)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.280223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92ba08-adec-4120-96b5-a26fd2342cf9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.295574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 480/935] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:19 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/9740cc30848f47db8cc5fa655c06d763/roles/00ca4f9d2ea94a1c994e042f537d1f13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:19.296784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.297075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.297353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.312170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1cd6-f4c4-4e71-b99e-361460e5efc5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.316568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:19.317024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:19.366966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.368868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.369341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.369797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.371214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:19.372197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.374232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.382686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 456/936] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:19.391399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.405439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 481/937] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:19.437202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.533222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2233ed-59c5-4a16-a74e-9ee621977a69 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.535570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.562476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.573300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.574206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.574568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.575002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.575830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:19.576201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.577627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.579287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd17db-e8cf-42ab-b94a-2a464570005f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.583497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 457/938] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:19.589914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.621798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.622618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.622896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.623166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.623846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.625209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:19.639623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:19.640644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:19.641478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 482/939] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:19.646873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.728230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975da6a1-4be8-463b-b02e-3efd9fda3712 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.764294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.764975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.765256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.765529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.766302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.767778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.771943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c684-2aaa-43ea-b351-3c9c105900db None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:19.791254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 458/940] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:19.832231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:19.833308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:19.833818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:19.834300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:19.835843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:19.836552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:19.838198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:19.844636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 483/941] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:19.853307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:19.884289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:19.971593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8792-499e-4bb9-a166-78dac580a8ee None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:20.008893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:20.009563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:20.009843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:20.010115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:20.010823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:20.011126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:20.012539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:20.017682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 459/942] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:20.024512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:20.042550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:20.140804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661ee72-8768-4d15-a670-fd2ad3d2da57 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:20.177265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:20.177947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:20.178231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:20.178507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:20.179609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] RBAC: Adding query filter params (interface=public, service_id=b54060c59aca4aac9fbc3064be54da09, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:20.180066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:20.181451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd437e-d4fd-4f1a-a4a6-d978d4e3c119 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:20.188513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 484/943] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:20 2022] GET /identity/v3/endpoints?service_id=b54060c59aca4aac9fbc3064be54da09&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:20.196614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:20.294995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:20.308631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcaa10-be21-4b19-92d4-d19a3d7b1b83 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:20.345399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:20.346070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:20.346358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:20.346640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:20.347328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:20.348739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf65c-6958-4634-acb6-261634761347 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:20.361977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 460/944] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:20 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:15:20.940972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66737-36ce-40fa-a5d5-fd76c1ac7b3e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:20.941997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66737-36ce-40fa-a5d5-fd76c1ac7b3e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:20.942512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c66737-36ce-40fa-a5d5-fd76c1ac7b3e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:20.944372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 485/945] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:20.950478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:20.950898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:20.951091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:20.968655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:20.969869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:21.044522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 461/946] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:21.068086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c66737-36ce-40fa-a5d5-fd76c1ac7b3e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:21.157323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:21.185331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c66737-36ce-40fa-a5d5-fd76c1ac7b3e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:21.222919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:21.223610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.224168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.224875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:21.226762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:21.228160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING keystone.server.flask.common [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:15:21.246250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.sql.core [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:15:21.246250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:15:21.246250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [parameters: {'id': '7e7fc87d7707408a9e58dfc3cdece7af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:15:21.246250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80364) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e7fc87d7707408a9e58dfc3cdece7af.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e7fc87d7707408a9e58dfc3cdece7af. May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:15:21.253954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 23 15:15:21.254755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return project_ref.to_dict() May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application yield resource May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise self.value May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application session.commit() May 23 15:15:21.255809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.flush() May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application compat.raise_( May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:15:21.257309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application c = connection._execute_20( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:15:21.258266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:15:21.259057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [parameters: {'id': '7e7fc87d7707408a9e58dfc3cdece7af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.261690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:21.263638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict( May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e7fc87d7707408a9e58dfc3cdece7af. May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:21.270723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 486/947] 10.222.0.46 () {60 vars in 1140 bytes} [Mon May 23 15:15:21 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:21.272109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:21.359953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:21.379483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a9b4-4008-4171-a27b-eab1fc465fa7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:21.415256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:21.415999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.416281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.416553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.423455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:21.424897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-176671f3-f874-4bba-abf6-8f43fd19b16e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:21.440096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:21.441068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:21.441959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 462/948] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:21.449390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:21.563894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b97f7a-f102-4e14-9073-2f84b74e7cab None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:21.597817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:21.603800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:21.604471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.604748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.605019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.605775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:21.606079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:21.607730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf20afa-b601-4275-8217-9fd7510102e7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:21.629729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 487/949] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:21.643573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52eca-aa1e-4bb1-9448-5bf8c43c25ce None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.643898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52eca-aa1e-4bb1-9448-5bf8c43c25ce None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.644141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b52eca-aa1e-4bb1-9448-5bf8c43c25ce None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.647087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 463/950] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:21.652661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.652962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.653233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.673195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:21.674707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:21.759506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 488/951] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:21.777053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52eca-aa1e-4bb1-9448-5bf8c43c25ce None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:21.889979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b52eca-aa1e-4bb1-9448-5bf8c43c25ce None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:21.926143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:21.926897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:21.927178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:21.927473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:21.939214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:21.948221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:21.949300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:21.950187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:21.954436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 464/952] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:21.955830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.069381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11116-e058-439a-a5fb-9a43e8e8d419 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.095508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.108618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.109293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.109572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.109847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.110592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:22.110893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.112305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fee8b2-ad78-4b57-9aa8-ac6822bba4a4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.121560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 489/953] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:22.127008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.129982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.231862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc2e0-56a9-4d05-b985-3751a1a12f21 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.232151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc2e0-56a9-4d05-b985-3751a1a12f21 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.232438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc2e0-56a9-4d05-b985-3751a1a12f21 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.234111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 490/954] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:22.236949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f17ca2-ddf4-49cc-bc03-5959be8fb2c0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.238929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.239216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.239541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.257952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:22.259144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:22.276697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.277935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.278462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.278879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.294004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.295878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:22.320278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:22.321436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:22.322551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:22.322551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:22.322551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:22.322551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:22.323704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 465/955] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:22.332372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.343751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 491/956] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:22.373091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.394420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.443705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cead-eabe-40a2-bf97-d38e03c59707 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.480173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186fdfe-474b-4b18-ba91-2d6cae941a8e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.480560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.481234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.481518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.481798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.482580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:22.482829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.484241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.496747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.497758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 466/957] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:22.503606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.520002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.521231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.521691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.522141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.523026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.524643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:22.538631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:22.540277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:22.541157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:22.544262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 492/958] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:22.550192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.657035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a61fe-f6bc-42a0-a54a-f318a66a5960 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.668717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdae9c9-8df9-4f16-87d5-663362e617d1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.674336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.699583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.700860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.701486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.702044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.704787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.705450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.705731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.706007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.706717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:22.707026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.708418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.712057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.718320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.718469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 493/959] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:22.719702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c0ca54bc-46a7-40cf-995b-91c6ec8813e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:22.736473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:22.737432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:22.738364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 467/960] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:22.739540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a04c3-aed8-45b0-97a6-194594a320dc None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.739540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a04c3-aed8-45b0-97a6-194594a320dc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.739868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a04c3-aed8-45b0-97a6-194594a320dc None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.741910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 468/961] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:22.743984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a04c3-aed8-45b0-97a6-194594a320dc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.765626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:22.832829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8bfc7-027c-4d26-a286-e01987a18e35 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.861305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a04c3-aed8-45b0-97a6-194594a320dc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:22.874700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.875432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.875718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.875993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.876699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:22.877012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.878369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52bac-2779-4866-a67a-9d190c4b03f9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.883308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 494/962] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:22.888871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.889160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.889432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.908354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:22.909480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:22.910102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:22.910602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:22.910720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:22.911839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:22.912036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:22.912545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:22.914752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:22.941206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 469/963] 10.222.0.46 () {56 vars in 1149 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:22.951222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:22.991873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.004423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 495/964] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:23.030181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.068168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.080211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffae999-f461-41ef-963e-ac1f758f8b47 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.120370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.121026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.121318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.121596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.142474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c58fa2-7c01-45ba-a693-42cc8abaf761 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.188400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.189486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.189846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.190445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.191409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.192859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.197468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.198928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:23.208224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:23.209254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:23.210153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:23.210897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 496/965] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:23.216092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.279598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.310644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 470/966] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:23.311650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.348055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.351959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afd36-826b-48b0-a32e-0750da45d4e1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.391978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.392751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.393110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.393461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.394306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:23.394689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.396185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.402583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 497/967] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:23.407792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.444595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dc0ed-98e6-4d62-a8b9-99d4fe5425c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.478209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.483972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.484894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.485181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.485459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.497423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.499019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:23.518436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:23.519643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:23.520571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:23.520571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:23.520571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:23.520571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:23.520571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 471/968] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:23.521671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07377b-72c9-4abd-8c20-8376710c55f7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.525280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.560115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.560718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.561006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.561286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.562068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:23.562383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.563793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.574355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 498/969] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:23.575402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.608317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.646988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d212358b-dd03-4380-a23b-5a0ee6e40d98 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.686176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31ece-33ef-448c-b8b1-7c6b1a575050 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.686806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.687886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.688542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.689024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.690003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:23.690514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.692208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.706470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 472/970] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:23.714712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:23.722621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.723625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.723873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.724156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.725025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.726746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.750651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 499/971] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:23 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:23.763777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:23.831226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703d168-607d-4e47-8a36-9da9ff766427 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:23.882001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:23.882810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:23.883097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:23.883411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:23.891097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:23.892628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:23.908682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:23.909662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:23.910581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 473/972] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:23.917879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:24.022436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:24.042092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16918e-d033-407c-9fe2-d69d7bdfbf69 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:24.078446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:24.079192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.079603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.079981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.080870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:24.081281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:24.082934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742ff8-e05f-46f9-85c3-be921cf602c9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:24.097197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 500/973] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:24.104628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:24.160236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35c54-f906-41ee-869f-d5a3a83662e4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.160864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35c54-f906-41ee-869f-d5a3a83662e4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.161346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35c54-f906-41ee-869f-d5a3a83662e4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.163784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 501/974] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:24.169061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.169610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.170093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.188917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:24.190527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:24.218166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:24.221700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d5d0-c877-431b-8a19-ee157c5e9ba3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:24.259522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:24.260181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.260469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.260746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.261586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] RBAC: Adding query filter params (role.id=00ca4f9d2ea94a1c994e042f537d1f13, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=9740cc30848f47db8cc5fa655c06d763) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:24.261899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:24.263355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:24.274837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 474/975] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:24 2022] GET /identity/v3/role_assignments?user.id=9740cc30848f47db8cc5fa655c06d763&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=00ca4f9d2ea94a1c994e042f537d1f13 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:24.282674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 502/976] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:24.309200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:24.426546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f00ba-50e1-4558-835d-661b75e5bb7f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:24.466785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:24.468135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.468624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.469176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.470157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:24.471838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:24.473358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING keystone.server.flask.common [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 23 15:15:24.486596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.sql.core [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:15:24.486596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:15:24.486596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [parameters: {'user_id': '9f54417c47b9440585bac6f7465a9248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:15:24.486596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80365) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application conn.query(q) May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result.read() May 23 15:15:24.504633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:15:24.505629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application next(self.gen) May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application yield resource May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application next(self.gen) May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.session.rollback() May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.force_reraise() May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise self.value May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application session.commit() May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 23 15:15:24.507279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._prepare_impl() May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.session.flush() May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._flush(objects) May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application compat.raise_( May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application flush_context.execute() May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rec.execute(self) May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 23 15:15:24.508205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application _emit_insert_statements( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = connection._execute_20( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ret = self._execute_context( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 23 15:15:24.509167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self.dialect.do_execute( May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result = self._query(query) May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application conn.query(q) May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application result.read() May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 23 15:15:24.510011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application packet.raise_for_error() May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [parameters: {'user_id': '9f54417c47b9440585bac6f7465a9248', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:24.510847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 23 15:15:24.516386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:24.517408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 475/977] 10.222.0.46 () {60 vars in 1131 bytes} [Mon May 23 15:15:24 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:24.517825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:24.600989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:24.627887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dab30-ab4a-4705-a1a4-2f249a5cb8d9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:24.664132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:24.664942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.665231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.665511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.673865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:24.675327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d0c3e52a-97ad-4dbe-9fd7-a94748b34258 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:24.690434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:24.691680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:24.693279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 503/978] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:24.698616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:24.731926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:24.807265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6851c8-963d-4d49-bb6b-7428c365a552 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:24.844289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:24.844970 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:24.845257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:24.845537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:24.846356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:24.846666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:24.848337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3dca5-75a6-4f07-8255-786fd71bd164 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:24.889440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 476/979] 10.222.0.46 () {56 vars in 1101 bytes} [Mon May 23 15:15:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:25.250580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092ca7-c9a1-402e-b588-911785e7f4b3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:25.251098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092ca7-c9a1-402e-b588-911785e7f4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:25.251422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092ca7-c9a1-402e-b588-911785e7f4b3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:25.253647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 504/980] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:25.260034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccce9e-fa0c-42f5-af1d-4e86c0535647 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:25.260484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccce9e-fa0c-42f5-af1d-4e86c0535647 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:25.260679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccce9e-fa0c-42f5-af1d-4e86c0535647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:25.279427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-efccce9e-fa0c-42f5-af1d-4e86c0535647 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:25.281053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-efccce9e-fa0c-42f5-af1d-4e86c0535647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:25.350397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 477/981] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:25.372593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092ca7-c9a1-402e-b588-911785e7f4b3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:25.478279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092ca7-c9a1-402e-b588-911785e7f4b3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:25.515045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:25.515752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:25.516044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:25.516326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:25.517056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:25.518425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831bf67-0d85-4082-8406-3dab72ad8076 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:25.520589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:25.533913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 505/982] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:25 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:26.177364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0258de-3697-44e3-8cf9-1c0059db1d23 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.177658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0258de-3697-44e3-8cf9-1c0059db1d23 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.178388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0258de-3697-44e3-8cf9-1c0059db1d23 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.180092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 478/983] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:26.185091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.185386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.185667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.203038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:26.204247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:26.281899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 506/984] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:26.304553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0258de-3697-44e3-8cf9-1c0059db1d23 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.321756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:26.415333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0258de-3697-44e3-8cf9-1c0059db1d23 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:26.452530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:26.453255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.453540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.453814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.454474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:26.455899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a0311ea1-13f7-44a5-8998-0bdbe3375dbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:26.468843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:26.469835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:26.470733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.475512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 479/985] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:26.476137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.575826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a282d-1b11-4811-9d75-ca8da990e39c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:26.595170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c05a6-eade-4abb-b5d1-9daea675243c None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.595495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c05a6-eade-4abb-b5d1-9daea675243c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.595785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c05a6-eade-4abb-b5d1-9daea675243c None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.597313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 480/986] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:26.598841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:26.603147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.603521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.603797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.616414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:26.617086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.617375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.617655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.618365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:26.618672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:26.620077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:26.621416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:26.622718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:26.625106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 507/987] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:26.630443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.699401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 481/988] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:26.720358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.731173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:26.742755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bea83-596f-4fe3-bb1b-a2a2a11f5389 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:26.777332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:26.778006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.778293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.778577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.779290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:26.779634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:26.781002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:26.785939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 508/989] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:26.792000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.843205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c4c47-439b-4142-8845-4e923d5a1488 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:26.847746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:26.882364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:26.883178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.883482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.883759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.884415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:26.885821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:26.898162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:26.899161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:26.900069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 482/990] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:26.905253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.905458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e146c-99bd-47e6-8f64-fb73ab200583 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:26.944636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:26.945297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:26.945577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:26.945853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:26.946650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] RBAC: Adding query filter params (interface=admin, service_id=b54060c59aca4aac9fbc3064be54da09, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:26.946960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:26.948834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:26.954729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 509/991] 10.222.0.46 () {56 vars in 1249 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/endpoints?service_id=b54060c59aca4aac9fbc3064be54da09&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:26.959941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:26.985728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:27.018606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b8913-7b83-4a13-a511-c7e9daf225f7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:27.053902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:27.054562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:27.054845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:27.055122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:27.055848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] RBAC: Adding query filter params (name=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:27.056502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:27.057512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:27.062467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 483/992] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:27.068184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:27.070119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfaf0e-d9e0-418e-88e8-aa903b37b721 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:27.084531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:27.108554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:27.109882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:27.109882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:27.109882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:27.110438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:27.111893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341acd0-3a98-47db-9bbb-742c0d2e6b67 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:27.127394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 510/993] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:26 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:15:27.194377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b7fc7-0226-4083-93cc-44e2be2d2210 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:27.232447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:27.233136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:27.233423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:27.233700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:27.234423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] RBAC: Adding query filter params (type=image) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:27.234733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:27.236226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8d85a-9377-4c58-8c78-da03c3633eca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:27.238784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:27.243152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 484/994] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:27.802082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282b9d9-b67d-465d-9ff1-6059438f5697 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:27.802631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282b9d9-b67d-465d-9ff1-6059438f5697 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:27.802714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282b9d9-b67d-465d-9ff1-6059438f5697 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:27.804415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 511/995] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:27.809524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:27.809959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:27.810065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:27.828155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:27.829362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:27.900083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 485/996] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:27.922332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282b9d9-b67d-465d-9ff1-6059438f5697 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:28.027301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282b9d9-b67d-465d-9ff1-6059438f5697 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:28.061502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:28.062228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:28.062511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:28.062775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:28.063450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:28.064807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:28.076509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:28.077483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:28.078345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:28.082724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 512/997] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:28.083608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:28.183614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c60691-8f5f-4376-bea9-ea0137315709 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:28.212925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:28.219975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:28.220641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:28.220923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:28.221198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:28.221905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:28.222212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:28.223632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:28.233250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 486/998] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:28.234473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:28.281126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:28.345906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8998c-6c12-45fa-b178-9bacf488dc37 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:28.382975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:28.384039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:28.384521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:28.385012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:28.385937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:28.386436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:28.388032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:28.393409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 513/999] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:28.399835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:28.502896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd987e75-84d2-4c58-bce4-202b2a1315f0 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:28.538475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:28.539132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:28.539441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:28.539721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:28.540506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] RBAC: Adding query filter params (interface=public, service_id=6cde9488eb5047b3bb87ca5614c3c618, region_id=RegionOne) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:28.540819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:28.542213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b1e53-67fe-48d4-b3b8-25a008374d10 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:28.547437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 487/1000] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:28 2022] GET /identity/v3/endpoints?service_id=6cde9488eb5047b3bb87ca5614c3c618&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:28.553297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:28.657030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a52b0-de52-40d9-8fea-601945ec2aec None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:28.659331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:28.694183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:28.694848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:28.695137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:28.695468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:28.697433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:28.698807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45221b7e-bf25-4282-90cf-16990e883d63 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:28.711384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 514/1001] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:28 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:15:29.370158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfacbf-e2e2-437d-b648-4c015acf17a9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.370716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfacbf-e2e2-437d-b648-4c015acf17a9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.370716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfacbf-e2e2-437d-b648-4c015acf17a9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.372245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 488/1002] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:29.377217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.377600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.377777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.395440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:29.397459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:29.445396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107ebe-b460-48b5-8790-d4bd8530274d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.445706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107ebe-b460-48b5-8790-d4bd8530274d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.445953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec107ebe-b460-48b5-8790-d4bd8530274d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.447479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 489/1003] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:29.452279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.452566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.452841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.469943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:29.471267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 515/1004] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:29.471496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:29.493624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:29.530579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:29.547278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 490/1005] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:29.569984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:29.603378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:29.607023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0481f7e-525d-4bf6-af1c-2102b8bf68d6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:29.642991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:29.644279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.644800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.645138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.645803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:29.647919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:29.660230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:29.661219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:29.662268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 516/1006] 10.222.0.46 () {56 vars in 1126 bytes} [Mon May 23 15:15:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:29.667396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:29.683756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471556-685b-42a9-afc5-0ada2e85c384 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:29.719109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:29.719805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.720093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.720373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.721098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:29.722477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:29.738859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 491/1007] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:29 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:29.783533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2907b-2e1c-4e66-9613-07b00597fcb1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:29.839339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:29.840191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:29.840487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:29.840772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:29.841758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:29.842074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:29.843524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:29.854708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 517/1008] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:29.855799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:29.913248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:29.971652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578a92-da6e-40f5-b400-ddd579cb02ef None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:30.007316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:30.008012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:30.008297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:30.008570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:30.009276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:30.009580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:30.010953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a556d-b02e-4a08-a1fd-00e3fbb52456 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:30.016097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 492/1009] 10.222.0.46 () {56 vars in 1122 bytes} [Mon May 23 15:15:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:30.022443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:30.048144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:30.128581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6423f0e-401d-435b-9032-45ae42a83a99 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:30.163805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:30.164395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:30.164687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:30.164969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:30.165715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:30.167164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a59e1-72cb-4b41-9390-2dfa751633a1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:30.187456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 518/1010] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:30.951682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70280a9-4dde-4dd9-aa9d-8fb88fdc5e69 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:30.952240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70280a9-4dde-4dd9-aa9d-8fb88fdc5e69 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:30.952240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70280a9-4dde-4dd9-aa9d-8fb88fdc5e69 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:30.953746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 493/1011] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:30.960020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:30.960434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:30.960605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:30.978612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:30.979866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:31.055233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 519/1012] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:31.078087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70280a9-4dde-4dd9-aa9d-8fb88fdc5e69 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:31.182700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70280a9-4dde-4dd9-aa9d-8fb88fdc5e69 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:31.196109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:31.218744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:31.219568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:31.219850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:31.220120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:31.220764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:31.222119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:31.233805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:31.234805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 23 15:15:31.236066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:31.237228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 494/1013] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:31.241758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:31.251858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:31.345663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa057b5-f0f1-4efa-93c7-06b9c79a33d3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:31.379474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:31.380173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:31.380458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:31.380735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:31.381440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:31.381744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:31.383107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:31.394086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 520/1014] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:31.394255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:31.504224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a63d-cf60-49d3-aaee-3bc450ed242b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:31.539392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:31.540056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:31.540337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:31.540609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:31.541314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:31.541616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:31.542996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdba881-0073-4f9a-8487-cef75893851a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:31.553390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 495/1015] 10.222.0.46 () {56 vars in 1112 bytes} [Mon May 23 15:15:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:31.554561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:31.625865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:31.656205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1774d-b3df-4f86-b124-eef496ccf75c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:31.690487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:31.691149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:31.691455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:31.691731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:31.692460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:31.693841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b3d5-a7da-4788-a921-a305f6263a56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:31.719399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 521/1016] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:32.033851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4daa74-c15d-4e6d-a964-d803649a5548 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.034414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4daa74-c15d-4e6d-a964-d803649a5548 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.034414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4daa74-c15d-4e6d-a964-d803649a5548 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.035975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 496/1017] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:32.041507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.041915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.042082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.059645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:32.060831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:32.152041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 522/1018] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:32.174819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4daa74-c15d-4e6d-a964-d803649a5548 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.220788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.287854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4daa74-c15d-4e6d-a964-d803649a5548 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.326459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.327257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.327570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.327852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.328513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.329906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-deaf5b3d-240a-429a-945f-c2d2310d0b1f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:32.342338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:32.343327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:32.344207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 497/1019] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:32.351495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.407601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.426700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735373-a402-4d00-8583-852c6dfd749a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.427658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735373-a402-4d00-8583-852c6dfd749a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.427916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce735373-a402-4d00-8583-852c6dfd749a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.429621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 498/1020] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:32.434467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.434742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.435026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.452038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:32.453236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:32.456999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca43de-b9b1-490b-8322-895bcd52a276 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.498287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.498956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.499236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.499536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.500246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] RBAC: Adding query filter params (name=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:32.500549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.501916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.507275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 523/1021] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:32.512845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.527767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 499/1022] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:32.550792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.585661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.623587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18b364-7a7a-4e0a-a966-339372ec30bc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.643205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.658633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88054f-24ca-4819-b88d-644081e89fcd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.662818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.663517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.663801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.664073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.664783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] RBAC: Adding query filter params (type=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:32.665085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.666443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.676208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 524/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:32.677284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.704471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.705689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.706097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.706512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.707979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.710665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.715654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 500/1024] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:32.719785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.789192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d906c-2cfe-4612-b320-6f4c08080d09 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.828825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.829496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.829779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.830060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.830871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] RBAC: Adding query filter params (interface=public, service_id=d8716f8659e94550bd571c0188844285, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:32.831166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.832575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.834213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619aedd-77a8-4df6-be6e-87fb293f6081 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:32.837653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.839407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 525/1025] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/endpoints?service_id=d8716f8659e94550bd571c0188844285&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:32.845052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:32.873090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:32.874095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:32.874534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:32.874972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:32.875859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:32.877467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826e601-eaef-4d5e-bf51-57ddf90c5249 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:32.897258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:32.906331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 501/1026] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:15:32 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:32.963004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897470-e546-4b27-baa0-38b1f9d11708 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:33.002331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:33.003027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:33.003313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:33.003633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:33.004336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:33.006004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5bb4-a8a5-463f-bc93-181ed6021554 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:33.019419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 526/1027] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:15:32 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:15:34.070183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598b97a-3163-46b2-9a47-d00967f7582b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.070717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598b97a-3163-46b2-9a47-d00967f7582b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.070717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598b97a-3163-46b2-9a47-d00967f7582b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.072440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 502/1028] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:34.078174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.078689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.078689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.095851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:34.097014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:34.172290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 527/1029] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:34.195543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598b97a-3163-46b2-9a47-d00967f7582b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:34.309486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598b97a-3163-46b2-9a47-d00967f7582b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:34.344304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:34.345042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.345326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.345598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.356753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:34.365039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:34.365976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:34.366832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 503/1030] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:34.372218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:34.415631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:34.475273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b9a58-3cb3-4ca9-9694-48a097108b94 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:34.517693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:34.518515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.518906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.519286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.520454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:34.520767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:34.522443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:34.535420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 528/1031] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:34.537706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:34.554789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:34.646129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84062e10-5d42-4aad-985f-00bb209b068d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:34.681323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:34.682120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.682409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.682682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.693087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:34.694555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:34.713020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:34.713967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:34.714880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:34.714880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:34.714880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:34.714880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:34.714880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 504/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:34.720128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:34.831047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a5245-5cb9-4b51-af7e-b74886e5204f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:34.833431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:34.869352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:34.870027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:34.870314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:34.870593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:34.871322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:34.871678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:34.873107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:34.889107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 529/1033] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:34.890284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:34.959900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:34.998676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fcd72-0396-4f90-bfb5-88d39b5447e8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.037772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.038578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.038860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.039134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.047202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.048800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5721ef2f-79a8-4b1e-b4d5-bb291653ce75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:35.063963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:35.064994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:35.065955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 505/1034] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:15:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:35.073075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.181098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535bfde-f00c-45b7-beab-9fe27f4581f3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.201124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90c0f-4d1e-46b7-8b7a-5b42cd70f888 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.201650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90c0f-4d1e-46b7-8b7a-5b42cd70f888 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.201650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90c0f-4d1e-46b7-8b7a-5b42cd70f888 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.203195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 506/1035] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:35.208908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659200-e76f-4e91-87fa-dc604219f1cc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.209200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659200-e76f-4e91-87fa-dc604219f1cc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.209478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab659200-e76f-4e91-87fa-dc604219f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.217866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.218551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.218835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.219114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.220020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:35.220331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.221772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.226505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ab659200-e76f-4e91-87fa-dc604219f1cc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:35.227727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab659200-e76f-4e91-87fa-dc604219f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:35.240507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 530/1036] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:35.246233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.270144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.297113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 507/1037] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:35.298445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab921dc-cbbb-475b-a449-75b64fc597a9 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.298738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab921dc-cbbb-475b-a449-75b64fc597a9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.299019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab921dc-cbbb-475b-a449-75b64fc597a9 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.300370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 508/1038] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:35.306151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.306446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.306729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.323310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:35.324688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:35.354444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63221147-1f5a-48fc-92a6-9b643f61959f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.375570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.389126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.389777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.390059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.390336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.392274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 509/1039] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:35.396258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.458839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.460323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.481118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.497395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3df3d-77e2-4aef-ac49-340c25e8098f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.530962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.531773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.532051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.532323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.533495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.534942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.537272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 510/1040] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:35.538037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.565960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 531/1041] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:15:35.566787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.604215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.648296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185852-e14f-4bcc-90e8-9f4b26fd8dfc None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.669823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62313a-af71-453e-b804-1e23d1dcb95d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.682317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.683102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.683409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.683694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] PATH_INFO: `/v3/services/image` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.684344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.685711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.689665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:35.697465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:35.698471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:35.699333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 511/1042] 10.222.0.46 () {56 vars in 1105 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:35.700170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.709956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.710622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.710905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.711176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.711917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.713332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.734115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 532/1043] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:15:35 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:35.734865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.819937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b9bca-8368-4d00-8732-851dd8c48586 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.839914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:35.860694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbc7ff-6aa0-4828-893d-e57c6bfbb511 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:35.860990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.861934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.862221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.862493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.876231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.877753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:35.898167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:35.899338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:35.900500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:35.900500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:35.900500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:35.900500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:35.904056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:35.904251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 512/1044] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:35.905147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:35.905264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.905773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:35.906224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:35.907192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] RBAC: Adding query filter params (name=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:35.907685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:35.909330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:35.914945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 533/1045] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:35.920864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:35.968099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:36.026233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923dac6-cb95-4392-adf9-10d0393512c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.041595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbab957-466a-4bb1-b38a-66bce98b1076 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.063268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.064230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.064511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.064782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.065667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:36.066275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.068444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.076294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.076958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.077246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.077573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.078282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] RBAC: Adding query filter params (type=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:36.078590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.079987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.088438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 513/1046] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:36.088596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 534/1047] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:36.092341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:36.092496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:36.124871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:36.201884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45688-3693-4706-bd1c-b225cba66487 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.206205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7f531-59e6-4266-8881-b5e27424393e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.210230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:36.240445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.241165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.241437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.241759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.244800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.245466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.245753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.246028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.246770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.248169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.248769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.250206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:36.265469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:36.266429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:36.267498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 514/1048] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:36.279977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 535/1049] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:15:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:15:36.280868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:36.388756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:36.400772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fd0d1-7097-4854-aa16-9dfaee32d120 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.446105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.446768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.447050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.447320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.448193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:36.448498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.450599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b19a2-61a1-4c4d-97c9-940f5fcea60a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.466651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 515/1050] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:36.472396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:36.576986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08804-23d7-44b7-aa7d-f49e7e5c714c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:36.612930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:36.613596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:36.614124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:36.614461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:36.615302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] RBAC: Adding query filter params (role.id=00ca4f9d2ea94a1c994e042f537d1f13, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:36.615648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:36.617085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee338f-e7f2-4d91-ada1-834e302cac04 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:36.622961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 536/1051] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:36 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=00ca4f9d2ea94a1c994e042f537d1f13 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:38.012621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1848-dd1c-4f89-8660-c713721a46b2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.013625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1848-dd1c-4f89-8660-c713721a46b2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.014134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1848-dd1c-4f89-8660-c713721a46b2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.016004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 516/1052] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:38.021500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.021911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.022087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.038917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:38.040128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:38.058972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.111288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 537/1053] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:38.135484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be1848-dd1c-4f89-8660-c713721a46b2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.238069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be1848-dd1c-4f89-8660-c713721a46b2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:38.280963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:38.281766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.282049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.282324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.293650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:38.301416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:38.302355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:38.303185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:38.304608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 517/1054] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:38.308566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.415995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da0a4-d53a-40e4-83ed-d6dae6cadf20 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:38.450269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:38.450946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.451231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.451543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.452297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:38.452605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:38.453974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1341ac-7a68-49e2-8605-31e5422c806a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:38.462809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 538/1055] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:38.468962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.479070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.530308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7023-5127-445e-aabc-cd10363be698 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.530562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7023-5127-445e-aabc-cd10363be698 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.530846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7023-5127-445e-aabc-cd10363be698 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.532390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 539/1056] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:38.537826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.538116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.538396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.555633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:38.556815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:38.568178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.579251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c102627-c8b0-442f-8d7a-bc30c5aac9ce None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:38.616875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:38.617748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.618033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.618309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] PATH_INFO: `/v3/users/1b49bfcdd5294e8d905201d8370aaf51` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.632793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=1b49bfcdd5294e8d905201d8370aaf51)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:38.633250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 540/1057] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:38.634460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:38.640886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 518/1058] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/users/1b49bfcdd5294e8d905201d8370aaf51 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:38.642497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.657307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.725821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.760217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9ff29-33ba-40ce-bbde-40cdc1995e66 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:38.771736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c784-58ed-43d5-8b94-338c68571ae4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:38.795311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:38.795989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.796272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.796544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.808987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:38.809781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.810165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.810543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.818238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.877135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:38.878609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478a96-8c4c-4950-8ab4-9e352683d41e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:38.886336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:38.887818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69ed93-9582-42d7-8efc-1c08a09e573b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:38.947271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:38.978596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 541/1059] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:38.979779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90893e-6631-41c1-a42e-9c3fdb37ee11 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.980141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90893e-6631-41c1-a42e-9c3fdb37ee11 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.980486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90893e-6631-41c1-a42e-9c3fdb37ee11 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:38.981836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 542/1060] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:38.984017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90893e-6631-41c1-a42e-9c3fdb37ee11 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:38.994795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 519/1061] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:15:38.996109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:38.996396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:38.996675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.012188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:39.013373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:39.031955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.080029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 520/1062] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:39.080885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.098247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90893e-6631-41c1-a42e-9c3fdb37ee11 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.133816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.134673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.134953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.135227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.136438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.137862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.139584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 543/1063] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:38 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:39.140326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.181164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.192314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ddcab-c9ec-42f0-b1ee-0abc20e5ea53 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.226256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.227044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.227324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.227623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.239261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.240532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b46944-9079-46fa-9b22-19c8f989b1bc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.240791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.254317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:39.257909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:39.258978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 521/1064] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:39.259978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.280711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.281514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.281796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.282075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.293432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:39.302285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:39.303312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:39.304193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 544/1065] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:39.304900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.363869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c795e-da8b-4046-9806-e55652c22233 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.398521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.399169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.399479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.399759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.400601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=d7615ddffe684e15ae8f78a9ad014c25, user.id=1b49bfcdd5294e8d905201d8370aaf51) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:39.400908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.402348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.407492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ad677-fa9e-4ba9-8d96-704f7fafad34 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.411898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 522/1066] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/role_assignments?user.id=1b49bfcdd5294e8d905201d8370aaf51&scope.project.id=d7615ddffe684e15ae8f78a9ad014c25&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:39.411898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.436113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.452067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.452749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.453042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.453322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.454064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:39.454377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.455837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.469840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 545/1067] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:39.542085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838192-6d38-4e41-b9db-5a699ad4a6a3 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.583103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.583764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.584051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.584313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.585203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:39.585533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.587140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.597533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 523/1068] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:39.603387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.642885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.716064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ac24-9a4b-45fc-8485-35b42957b7cb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.752598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.753415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.753699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.754562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.765692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.767155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:39.786023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:39.786992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:39.787945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:39.787945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:39.787945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:39.787945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:39.787945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 546/1069] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:39.793264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:39.870297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:39.900617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae00995-2e52-48f4-9dcf-5afc8742c308 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:39.935111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:39.935810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:39.936097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:39.936376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:39.937101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:39.937410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:39.938783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:39.950574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 524/1070] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:39.956145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.041983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:40.058014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea116f-58e9-4712-ba5a-ea357865e14a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.091535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.092336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.092624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.092900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.101287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.102727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:40.117052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:40.118204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:40.123969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 547/1071] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:40.125155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.225417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02d02-51a3-43e7-9a7a-c5f73b670768 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.256130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:40.261559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.262261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.262546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.262823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.263773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:40.264084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.265521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.283081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 525/1072] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:15:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:40.288875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.389423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114d9b1-786b-4f6a-9a87-70b15926e578 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.421974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.422763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.423043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.423317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.434562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.436023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.442722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:40.454270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:40.455355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:40.456294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:40.456294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:40.456294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:40.456294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:40.456294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 548/1073] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:40.461135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.563057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c041f-c59d-4d8d-b47e-2bc77fe28d1e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.598765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.599463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.599750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.600026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.600742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:40.601046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.602416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.614444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 526/1074] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:40.620115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.718131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94172a7-8e7e-43cc-8ed7-8cbca630dc77 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.751309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.752121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.752407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.752685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.759332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.760798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:40.774799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:40.775870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:40.776799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 549/1075] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:40.781758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.833098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:40.884109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7aa33-3fbf-4ba3-a82a-2dc9609d2d1c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:40.918515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:40.919173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:40.919483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:40.919758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:40.920536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:40.920841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:40.922281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b69b-283c-474f-8855-c098076ce200 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:40.934659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 527/1076] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:40.940169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:40.999386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:41.041770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ce5ee-ccc5-474d-b9d3-ad5b88df8f09 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:41.075071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:41.075992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:41.076278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:41.076556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/00ca4f9d2ea94a1c994e042f537d1f13` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:41.078757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=b485e0918e744da9875e48e7906264e9, role_id=00ca4f9d2ea94a1c994e042f537d1f13)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:41.080240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3632126e-9371-43f8-bf42-960b33532eb3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:41.093734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 550/1077] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:40 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/b485e0918e744da9875e48e7906264e9/roles/00ca4f9d2ea94a1c994e042f537d1f13 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:41.662743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa493aa-4bba-423a-87da-2910d73685a4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:41.663313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa493aa-4bba-423a-87da-2910d73685a4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:41.663313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa493aa-4bba-423a-87da-2910d73685a4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:41.664721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 528/1078] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:41.670154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:41.670448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:41.670733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:41.687425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:41.688618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:41.754417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 551/1079] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:41.777462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa493aa-4bba-423a-87da-2910d73685a4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:41.886484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa493aa-4bba-423a-87da-2910d73685a4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:41.897915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:41.922589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:41.923307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:41.923619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:41.923893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:41.934885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:41.942530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:41.943605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:41.944458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 529/1080] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:41.949857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:41.998591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:42.047622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac337-0d42-4267-89af-9585bfb32e13 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:42.080604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:42.081268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:42.081553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:42.081918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:42.082662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:42.082971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:42.084369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:42.092876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 552/1081] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:42.099497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:42.199038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2eb37a-4f52-49cd-88b1-801fd4afdeea None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:42.233133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:42.234007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:42.234294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:42.234570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] PATH_INFO: `/v3/users/1b49bfcdd5294e8d905201d8370aaf51` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:42.235790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1b49bfcdd5294e8d905201d8370aaf51)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:42.237247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:42.239533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 530/1082] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:42 2022] GET /identity/v3/users/1b49bfcdd5294e8d905201d8370aaf51 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:42.245222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:42.344998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c48acb-7969-4dfc-96fc-51537039fcac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:42.355867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:42.379026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:42.379909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:42.380197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:42.380476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:42.381661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:42.383079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb2e15-da92-45ab-880f-60cb57673416 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:42.384811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 553/1083] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:42 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:42.390688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:42.430996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:42.490633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e72fe-a653-4b32-9bfa-f217e262f0e1 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:42.523710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:42.524586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:42.524868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:42.525143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25/users/1b49bfcdd5294e8d905201d8370aaf51/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:42.527101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] RBAC: Authorizing `identity:create_grant(project_id=d7615ddffe684e15ae8f78a9ad014c25, user_id=1b49bfcdd5294e8d905201d8370aaf51, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:42.528613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2398b-1dde-4aba-be63-f075b39b496d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:42.542120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 531/1084] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:42 2022] PUT /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25/users/1b49bfcdd5294e8d905201d8370aaf51/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:43.285308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2a2b-0622-41d0-9f21-e2dbf49d8126 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:43.285874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2a2b-0622-41d0-9f21-e2dbf49d8126 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:43.285874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf2a2b-0622-41d0-9f21-e2dbf49d8126 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:43.287201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 554/1085] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:43.292445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:43.292868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:43.293006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:43.310075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:43.311256 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:43.385938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 532/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:43.409461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2a2b-0622-41d0-9f21-e2dbf49d8126 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:43.509934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf2a2b-0622-41d0-9f21-e2dbf49d8126 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:43.542689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:43.543453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:43.543736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:43.544008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:43.553729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:43.561692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:43.562603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:43.563516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 555/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Mon May 23 15:15:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:43.569438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:43.598139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:43.674158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5d970-2ead-4287-8a1d-4b6e2dacd371 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:43.710279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:43.710954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:43.711239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:43.711545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:43.712301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:43.712609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:43.714027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:43.722424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 533/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:15:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:43.728161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:43.767756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:43.833519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045a85c-11f2-4a0e-baa1-5c3cb3423eef None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:43.869082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:43.869875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:43.870167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:43.870446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:43.881010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:43.882469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:43.899742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:43.900790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:43.901727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:43.901727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:43.901727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:43.901727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:43.901727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 556/1089] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:43.906577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:43.996704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.007170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bea3f-0bb5-4d34-8403-d2f1260a2042 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.040601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:44.041253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.041532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.041802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.042518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:44.042822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:44.044217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:44.056688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 534/1090] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:44.062132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.152324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.162879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d57747-9e15-48a0-b2a9-115e5312f5f6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.197248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:44.198033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.198316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.198592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.205693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:44.207482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:15:44.222871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:44.223892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:44.224842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 557/1091] 10.222.0.46 () {56 vars in 1093 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:44.230003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.332444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30f5d-7719-4535-b4ab-3872a6a77e61 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.367648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:44.368341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.368621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.368892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.369716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:44.370020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:44.371459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:44.388703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 535/1092] 10.222.0.46 () {56 vars in 1133 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:44.394423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.493390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0582-7384-4d84-9ac3-0f6b21029714 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.526608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:44.527255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.527574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.527859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.546198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.601829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:44.603278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d216d2-d2fe-4abb-b64f-aeb2afce6601 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:44.704404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 558/1093] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:15:44.710965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.722814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.760407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23ce3-0e4c-44a2-8390-1b240a1a1cca None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.760626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23ce3-0e4c-44a2-8390-1b240a1a1cca None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.760936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23ce3-0e4c-44a2-8390-1b240a1a1cca None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.762323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 559/1094] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:15:44.767305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.767632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.767917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.785947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:44.787141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:44.813478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399fec-52a7-41a0-a277-9d511c850ecb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.835180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.850089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:44.850884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:44.851168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:44.851476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:44.856761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 560/1095] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:44.861731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:44.863191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:44.880266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:15:44.880472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:44.881487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:44.882496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:15:44.882496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:15:44.882496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:15:44.882496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:44.882496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 536/1096] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:15:44.887033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:44.946689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:44.979706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a646b-2c0b-47c6-8d95-f164678c6052 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:44.988682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c117296-79d8-4ea0-9b78-d131a158dd00 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.013318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.014045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.014329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.014604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.022728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.023408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.023700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.023977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.024698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:45.025007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.025158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:15:45.026387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:15:45.033810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:45.035350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:15:45.036799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 561/1097] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:45.039962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 537/1098] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:45.041880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.045386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.083432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.141499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d4a8-466b-4d77-8681-08a2723f633d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.145448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269b732-fb41-464a-ab39-f15316a8002c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.165600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.176704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.177366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.177646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.177921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.178660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:45.178967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.180377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.181296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.182077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.182355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.182624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.188631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 562/1099] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:45.189449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.191542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.195113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:15:45.205766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:15:45.206989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:15:45.207941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 538/1100] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:15:45.212836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.295087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75b24-fc71-4cd7-abe8-2aef15c0a11c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.296558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.313471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68d68d-1818-40c6-beb8-b92ce9bd5687 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.329747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.330617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.330901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.331698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] PATH_INFO: `/v3/users/1b49bfcdd5294e8d905201d8370aaf51` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.332912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] RBAC: Authorizing `identity:get_user(user_id=1b49bfcdd5294e8d905201d8370aaf51)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.334334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.336193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 563/1101] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/users/1b49bfcdd5294e8d905201d8370aaf51 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:45.341907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.350269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.350936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.351224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.351538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.352330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:45.352644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.354090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.370607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 539/1102] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:45.371602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.414335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.440939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05217f02-d2b2-4bfd-b612-f6ad6e92004d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.472840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fcbe3-edc3-44fd-83be-d65cd2966153 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.474301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.474956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.475240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.475545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.506950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.507635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.507920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.508192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.509006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] RBAC: Adding query filter params (role.id=00ca4f9d2ea94a1c994e042f537d1f13, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=b485e0918e744da9875e48e7906264e9) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:45.509311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.510823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.515089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.517276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 540/1103] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/role_assignments?user.id=b485e0918e744da9875e48e7906264e9&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=00ca4f9d2ea94a1c994e042f537d1f13 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:45.548077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.549463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.657570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 564/1104] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 23 15:15:45.663819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.771030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a057b-c6c1-49a0-bade-486add888df6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.773490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.807507 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.808295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.808581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.808858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.810040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.811574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f3f06-5bec-42d9-b557-0b2f24713ee7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.813285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 541/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:45.820585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:45.890207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:45.923079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628a02-3e50-4b21-8fb8-2fb2308ec02f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:45.957146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:45.957809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:45.958085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:45.958356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:45.959182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=d7615ddffe684e15ae8f78a9ad014c25, user.id=1b49bfcdd5294e8d905201d8370aaf51) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:45.959519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:45.960948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a46213-03da-45d0-91b4-d4b7df8ea0b2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:45.967289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 565/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:45 2022] GET /identity/v3/role_assignments?user.id=1b49bfcdd5294e8d905201d8370aaf51&scope.project.id=d7615ddffe684e15ae8f78a9ad014c25&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:48.214099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0447f1-79e8-40f0-b91f-263a71ceea6d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:48.214881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0447f1-79e8-40f0-b91f-263a71ceea6d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:48.214972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0447f1-79e8-40f0-b91f-263a71ceea6d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:48.216330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 542/1107] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:48.221453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:48.222009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:48.222196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:48.238592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:48.239827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:48.305615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 566/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:48.330174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0447f1-79e8-40f0-b91f-263a71ceea6d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:48.431193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0447f1-79e8-40f0-b91f-263a71ceea6d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:48.463944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:48.465034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:48.465259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:48.465530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:48.466685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:48.468136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6dfb6-5b4e-4b6c-897e-1c00b9ea0ff0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:48.469735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 543/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:48.475586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:48.535971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:48.574390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad41ddc-1884-4c56-9980-85e3d9d4c1cc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:48.608662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:48.609326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:48.609613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:48.609891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:48.610595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:48.612572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab18f53-5d5f-44c5-be8d-af789c96a4e3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:48.632225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 567/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:15:48 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:15:50.835971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7112-1c7d-4ebd-883b-a35ba3d980c3 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:50.836418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7112-1c7d-4ebd-883b-a35ba3d980c3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:50.836532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f7112-1c7d-4ebd-883b-a35ba3d980c3 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:50.837926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 544/1111] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:50.843225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:50.843613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:50.843826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:50.860091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:50.861254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:50.925934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 568/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:50.949383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f7112-1c7d-4ebd-883b-a35ba3d980c3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:50.992933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:51.053897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f7112-1c7d-4ebd-883b-a35ba3d980c3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:51.086896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:51.087706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:51.087992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:51.088270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] PATH_INFO: `/v3/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:51.090035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] RBAC: Authorizing `identity:get_role(role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:51.091439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:51.092844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 545/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:50 2022] GET /identity/v3/roles/e44bbee3e1df41568b635760aa1e44dd => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:51.099301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:51.146906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:51.195180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bd55b-2b31-4b9b-8351-adab3c6d1ca5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:51.227935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072011b-3850-446d-a338-d486441935df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:51.228790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072011b-3850-446d-a338-d486441935df None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:51.229071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072011b-3850-446d-a338-d486441935df None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:51.229395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072011b-3850-446d-a338-d486441935df None admin] PATH_INFO: `/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:51.242897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072011b-3850-446d-a338-d486441935df None admin] RBAC: Authorizing `identity:get_user(user_id=ddd0fb8fe6594e5484c2cf74d19ff27b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:51.244371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072011b-3850-446d-a338-d486441935df None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:51.246024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 569/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:51 2022] GET /identity/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:51.251639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:51.350801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db8d5a-728e-4b03-98f3-6de262d3e3c5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:51.359261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:51.385590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:51.386251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:51.386536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:51.386815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:51.453109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:51.454578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:51.550935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 546/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:51.556832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072011b-3850-446d-a338-d486441935df None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:51.653351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072011b-3850-446d-a338-d486441935df None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:51.663350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:51.687950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:51.688805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:51.689088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:51.689364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:51.691089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:51.692559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cff12-d847-474a-a21b-6a39b7e3431e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:51.694244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 570/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:51 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:51.700262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:51.710793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:51.798277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261783-9048-4ffe-8899-491231d74420 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:51.832547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:51.833199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:51.833482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:51.833756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:51.834575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=d7615ddffe684e15ae8f78a9ad014c25, user.id=ddd0fb8fe6594e5484c2cf74d19ff27b) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:51.834885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:51.836362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48176d6e-b03d-45e2-acc5-4e87bfc5690f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:51.841973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 547/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:51 2022] GET /identity/v3/role_assignments?user.id=ddd0fb8fe6594e5484c2cf74d19ff27b&scope.project.id=d7615ddffe684e15ae8f78a9ad014c25&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:53.992518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3e72-d583-4593-8acc-27b724e9eb2a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:53.993064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3e72-d583-4593-8acc-27b724e9eb2a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:53.993064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de3e72-d583-4593-8acc-27b724e9eb2a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:53.994438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 571/1118] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:53.999612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:54.000018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:54.000168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:54.017217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:54.019103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:54.084305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 548/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 23 15:15:54.107682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de3e72-d583-4593-8acc-27b724e9eb2a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:54.206142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de3e72-d583-4593-8acc-27b724e9eb2a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:54.238799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:54.239665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:54.239947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:54.240219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] PATH_INFO: `/v3/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:54.241685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] RBAC: Authorizing `identity:get_role(role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:54.243048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:54.244420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 572/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:54 2022] GET /identity/v3/roles/e44bbee3e1df41568b635760aa1e44dd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:54.249975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:54.252876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:54.348639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42616-1651-4e24-b83b-2397b6623202 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:54.381607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:54.382467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:54.382752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:54.383029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] PATH_INFO: `/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:54.384252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] RBAC: Authorizing `identity:get_user(user_id=ddd0fb8fe6594e5484c2cf74d19ff27b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:54.385688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:54.387314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 549/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:54 2022] GET /identity/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:54.393442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:54.440464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:54.493938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501c28a-2cd3-4934-8921-2e4ffd93bf8e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:54.526697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:54.527573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:54.527858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:54.528137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:54.529309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:54.530722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbca3a-d535-4c75-89be-f15ca6eba7dc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:54.532439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 573/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:54 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:15:54.539152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:54.607922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:54.638342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aeb450-63b4-4fd1-8c4d-769a014a473c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:54.672636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:54.673502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:54.673825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:54.674138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25/users/ddd0fb8fe6594e5484c2cf74d19ff27b/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:54.676331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] RBAC: Authorizing `identity:create_grant(project_id=d7615ddffe684e15ae8f78a9ad014c25, user_id=ddd0fb8fe6594e5484c2cf74d19ff27b, role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:54.677761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef096130-1c49-4208-b171-ac3acf9bbc4d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:54.690185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 550/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:15:54 2022] PUT /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25/users/ddd0fb8fe6594e5484c2cf74d19ff27b/roles/e44bbee3e1df41568b635760aa1e44dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:15:56.864335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28eaec-6023-474b-b1e5-be212f08e67e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:56.864813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28eaec-6023-474b-b1e5-be212f08e67e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:56.864906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28eaec-6023-474b-b1e5-be212f08e67e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:56.866266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 574/1124] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:15:56.871475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:56.871864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:56.872039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:56.888098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:15:56.889304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:15:56.954737 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 551/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:15:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:15:56.978624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28eaec-6023-474b-b1e5-be212f08e67e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:57.077392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28eaec-6023-474b-b1e5-be212f08e67e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:57.090877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:57.111150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:57.112071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:57.112351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:57.112653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] PATH_INFO: `/v3/roles/e44bbee3e1df41568b635760aa1e44dd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:57.114128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] RBAC: Authorizing `identity:get_role(role_id=e44bbee3e1df41568b635760aa1e44dd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:57.115534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:57.116894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 575/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:56 2022] GET /identity/v3/roles/e44bbee3e1df41568b635760aa1e44dd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:57.122637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:57.180305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:57.221914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc4205-c933-4291-93ea-ed22c2ff0152 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:57.254377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:57.255231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:57.255541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:57.255816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] PATH_INFO: `/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:57.256993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] RBAC: Authorizing `identity:get_user(user_id=ddd0fb8fe6594e5484c2cf74d19ff27b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:57.258434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:57.260103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 552/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:15:57 2022] GET /identity/v3/users/ddd0fb8fe6594e5484c2cf74d19ff27b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:57.265730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:57.363120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6ea80-9e2f-4c58-8ecc-340b1fe51c0e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:57.395645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:57.396272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:57.396556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:57.396835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:57.443081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:57.462792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:57.464519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:57.559416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 576/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:15:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:15:57.565224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:57.663824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ade155-8d8e-429a-957c-ea72f0c4b0bb None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:57.688811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:57.697505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:57.698357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:57.698641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:57.698916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] PATH_INFO: `/v3/projects/d7615ddffe684e15ae8f78a9ad014c25` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:57.700118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] RBAC: Authorizing `identity:get_project(project_id=d7615ddffe684e15ae8f78a9ad014c25)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:57.701558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1096e2-3112-4a3c-8a11-cc9aa32afb24 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:57.703255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 553/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:15:57 2022] GET /identity/v3/projects/d7615ddffe684e15ae8f78a9ad014c25 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:15:57.709747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:15:57.788618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:15:57.807694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c2a8-b783-4060-a81a-43eff4019e83 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:15:57.842597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:15:57.843252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:15:57.843571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:15:57.843852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:15:57.844681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] RBAC: Adding query filter params (role.id=e44bbee3e1df41568b635760aa1e44dd, scope.project.id=d7615ddffe684e15ae8f78a9ad014c25, user.id=ddd0fb8fe6594e5484c2cf74d19ff27b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:15:57.844995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:15:57.846465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e33e6-2357-4a7b-98bc-91fae1be481d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:15:57.852254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 577/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:15:57 2022] GET /identity/v3/role_assignments?user.id=ddd0fb8fe6594e5484c2cf74d19ff27b&scope.project.id=d7615ddffe684e15ae8f78a9ad014c25&role.id=e44bbee3e1df41568b635760aa1e44dd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:00.085036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa441-2e54-4aed-847a-2a23a90a6892 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:00.085540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa441-2e54-4aed-847a-2a23a90a6892 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:00.085540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa441-2e54-4aed-847a-2a23a90a6892 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:00.086882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 554/1131] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:00.092713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:00.093112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:00.093264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:00.110049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:00.111862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:00.177573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 578/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:00.200747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa441-2e54-4aed-847a-2a23a90a6892 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:00.300983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa441-2e54-4aed-847a-2a23a90a6892 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:00.333559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:00.334328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:00.334611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:00.334881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:00.336107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:00.337494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a83a88-628b-4ac4-8bd4-f5d2a98d02ef None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:00.339338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 555/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:00.345009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:00.416257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:00.440599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938f2e1-522b-460a-bb27-142ccce23959 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:00.474407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:00.475060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:00.475342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:00.475649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:00.476443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:00.477857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19323f-80bb-4a94-ac69-19dfe702cc79 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:00.502577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 579/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:16:00 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:16:02.811927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc88cf-bdce-4060-bda0-40773eaa2725 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:02.812827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc88cf-bdce-4060-bda0-40773eaa2725 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:02.812827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc88cf-bdce-4060-bda0-40773eaa2725 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:02.813988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 556/1135] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:02.820083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:02.820533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:02.820813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:02.839656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:02.840840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:02.916798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 580/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:02.943264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc88cf-bdce-4060-bda0-40773eaa2725 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:03.026055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:03.068210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc88cf-bdce-4060-bda0-40773eaa2725 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:03.105580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:03.106410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:03.106696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:03.106975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:03.108220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:03.109662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe99e6-7d6c-45e9-bdde-aa32818e74df None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:03.112094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 557/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:16:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:03.117917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:03.180981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:03.226087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0a151-9b87-4195-8364-99d8f882c34e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:03.259111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:03.259808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:03.260093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:03.260370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:03.261075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:03.262506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396a9e6-e727-4ed1-8926-d99ddd5b605b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:03.282846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 581/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:16:03 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:16:05.534814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ac5-a4dc-4cad-afe8-c58a1d156b01 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:05.535393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ac5-a4dc-4cad-afe8-c58a1d156b01 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:05.535393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684ac5-a4dc-4cad-afe8-c58a1d156b01 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:05.536769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 558/1139] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:05.542028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:05.542409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:05.542588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:05.559439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:05.560618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:05.627695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 582/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:05.650839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684ac5-a4dc-4cad-afe8-c58a1d156b01 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:05.753967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684ac5-a4dc-4cad-afe8-c58a1d156b01 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:05.783158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:05.788436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:05.789166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:05.789447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:05.789721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:05.801064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:05.808734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:05.809680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:05.810631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 559/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:05.815977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:05.858429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:05.914748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f583a67-3dd5-49d2-ab6a-11d6e45ad1dc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:05.947743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:05.948407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:05.948694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:05.948973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:05.949716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:05.950024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:05.951420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:05.960006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 583/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:05.965980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:06.062839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70592-7c78-4a88-8c95-67a89c66ec25 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:06.097222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:06.098069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:06.098349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:06.098620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] PATH_INFO: `/v3/users/93d1de1dbf2b410eb6656589376cf4e9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:06.111464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] RBAC: Authorizing `identity:get_user(user_id=93d1de1dbf2b410eb6656589376cf4e9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:06.112924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:06.114548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 560/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:05 2022] GET /identity/v3/users/93d1de1dbf2b410eb6656589376cf4e9 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:06.120118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:06.218789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624f33-cdf7-4719-93b9-a506b76515e6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:06.221283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:06.252067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:06.252718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:06.252998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:06.253275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:06.317573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:06.318934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:06.412880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 584/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:16:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:16:06.418618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:06.468318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:06.518665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db582b20-be23-494c-be40-7cf3f6b53dab None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:06.552214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:06.553058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:06.553338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:06.553608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] PATH_INFO: `/v3/projects/17a63f703a854daea6f2f644578d677f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:06.554777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] RBAC: Authorizing `identity:get_project(project_id=17a63f703a854daea6f2f644578d677f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:06.556245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432fc30-d44b-4509-9363-10ff86e1ebff None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:06.557945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 561/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:06 2022] GET /identity/v3/projects/17a63f703a854daea6f2f644578d677f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:06.564724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:06.567886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:06.662196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce3e49-9599-4ebd-91bb-6e465841a79d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:06.696003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:06.696655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:06.696944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:06.697227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:06.698055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=17a63f703a854daea6f2f644578d677f, user.id=93d1de1dbf2b410eb6656589376cf4e9) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:06.698373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:06.699832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5729b5-cb80-4b5a-970e-db2dbba1b9d7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:06.705344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 585/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:16:06 2022] GET /identity/v3/role_assignments?user.id=93d1de1dbf2b410eb6656589376cf4e9&scope.project.id=17a63f703a854daea6f2f644578d677f&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:08.862014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355df29-9b7d-4429-b577-05c03df1b1aa None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:08.862472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355df29-9b7d-4429-b577-05c03df1b1aa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:08.862559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355df29-9b7d-4429-b577-05c03df1b1aa None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:08.863971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 562/1147] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:16:08.869122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:08.869488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:08.869674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:08.886464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:08.887768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:08.946433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:08.952071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 586/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:08.974850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355df29-9b7d-4429-b577-05c03df1b1aa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:09.074257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355df29-9b7d-4429-b577-05c03df1b1aa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:09.091041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:09.108267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:09.109048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:09.109335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:09.109614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:09.120163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:09.127869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:09.128999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:09.130081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 563/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:09.135105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:09.230153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d599ab-9bbf-49a0-87b8-5600252cffff None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:09.262494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:09.263144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:09.263452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:09.263731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:09.264462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:09.264765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:09.266152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:09.273870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 587/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:09.279596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:09.378173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893bbac-df86-4fb0-8715-8c8cb65d7b91 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:09.411282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:09.412151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:09.412435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:09.412710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] PATH_INFO: `/v3/users/93d1de1dbf2b410eb6656589376cf4e9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:09.413899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] RBAC: Authorizing `identity:get_user(user_id=93d1de1dbf2b410eb6656589376cf4e9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:09.415347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:09.416996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 564/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:09 2022] GET /identity/v3/users/93d1de1dbf2b410eb6656589376cf4e9 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:09.422939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:09.481169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:09.521870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e3c5-42bf-4850-bb5a-17543c48a2e8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:09.554483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:09.555328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:09.555640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:09.555913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] PATH_INFO: `/v3/projects/17a63f703a854daea6f2f644578d677f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:09.557086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] RBAC: Authorizing `identity:get_project(project_id=17a63f703a854daea6f2f644578d677f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:09.558513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcfa5e-042e-4a15-abbf-35187f800e93 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:09.560226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 588/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:09 2022] GET /identity/v3/projects/17a63f703a854daea6f2f644578d677f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:09.566324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:09.612830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:09.665544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758e003-34f9-433d-b848-7bc22ab60140 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:09.698387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:09.699264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:09.699578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:09.699856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] PATH_INFO: `/v3/projects/17a63f703a854daea6f2f644578d677f/users/93d1de1dbf2b410eb6656589376cf4e9/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:09.701820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] RBAC: Authorizing `identity:create_grant(project_id=17a63f703a854daea6f2f644578d677f, user_id=93d1de1dbf2b410eb6656589376cf4e9, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:09.703275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26af1de-340d-47d9-b36d-0dcaa00eeeca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:09.717059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 565/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:16:09 2022] PUT /identity/v3/projects/17a63f703a854daea6f2f644578d677f/users/93d1de1dbf2b410eb6656589376cf4e9/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:16:11.892809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a617e4-e482-4e99-911e-416357b75193 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:11.893353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a617e4-e482-4e99-911e-416357b75193 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:11.893353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a617e4-e482-4e99-911e-416357b75193 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:11.894734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 589/1154] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:16:11.899954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:11.900347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:11.900517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:11.917748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:11.918938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:11.985573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 566/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:12.008421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a617e4-e482-4e99-911e-416357b75193 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:12.107778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a617e4-e482-4e99-911e-416357b75193 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:12.133652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:12.142178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:12.142990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:12.143276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:12.143586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:12.154192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:12.162592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:12.163803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:16:12.165175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 590/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:16:12.169878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:12.203513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:12.268886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb8f2-9423-498a-aba1-a23d8d43ad62 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:12.302326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:12.302984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:12.303269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:12.303580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:12.304325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:12.304632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:12.306023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:12.314226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 567/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:12.319927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:12.416056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a16bc-006d-4ebc-b218-63ae9daff6c5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:12.449362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:12.450215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:12.450498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:12.450772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] PATH_INFO: `/v3/users/93d1de1dbf2b410eb6656589376cf4e9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:12.451967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] RBAC: Authorizing `identity:get_user(user_id=93d1de1dbf2b410eb6656589376cf4e9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:12.453622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:12.455234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 591/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/users/93d1de1dbf2b410eb6656589376cf4e9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:12.460935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:12.555886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:12.560020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2331e-ebfc-43fa-b2f6-d3935e9c4467 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:12.594669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:12.595307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:12.595622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:12.595895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:12.661493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:12.662937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:12.754206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:12.759021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 568/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:16:12.764725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:12.820059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:12.864024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5d003-6d0c-4ae4-b858-03196e541a0f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:12.897200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:12.898049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:12.898338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:12.898621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] PATH_INFO: `/v3/projects/17a63f703a854daea6f2f644578d677f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:12.899837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] RBAC: Authorizing `identity:get_project(project_id=17a63f703a854daea6f2f644578d677f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:12.901280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e0c52-d9f1-4075-82b1-fe3fe8c589b0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:12.902986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 592/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/projects/17a63f703a854daea6f2f644578d677f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:12.909328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:13.006475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79dc4a-3f51-47d3-83bf-9bff9f4f6dea None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:13.039366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:13.040020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:13.040304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:13.040582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:13.041399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=17a63f703a854daea6f2f644578d677f, user.id=93d1de1dbf2b410eb6656589376cf4e9) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:13.041709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:13.043137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a84b2-c968-45bc-b688-d6ed7570d4c0 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:13.049377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 569/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:16:12 2022] GET /identity/v3/role_assignments?user.id=93d1de1dbf2b410eb6656589376cf4e9&scope.project.id=17a63f703a854daea6f2f644578d677f&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:15.234064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ccdd-03f4-451b-abde-8d095ff452f3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:15.234799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ccdd-03f4-451b-abde-8d095ff452f3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:15.234799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ccdd-03f4-451b-abde-8d095ff452f3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:15.236031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 593/1162] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:15.241239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:15.241660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:15.241798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:15.258910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:15.260132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:15.316871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:15.327188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 570/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:15.349352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ccdd-03f4-451b-abde-8d095ff452f3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:15.449527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ccdd-03f4-451b-abde-8d095ff452f3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:15.472591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:15.483431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:15.484648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:15.485117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:15.485608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:15.551155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:15.552669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:15.647669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 594/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:16:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:16:15.653740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:15.751161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ac382-9f2f-4659-a83a-f43d82361722 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:15.784095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:15.784873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:15.785149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:15.785415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:15.791907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:15.793353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d2562f0b-2012-41f8-9f50-ae0a4d4aa654 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:15.807451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:15.808589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:15.809465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 571/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:16:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:15.815185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:15.840354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:15.912823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb602b-dc01-4e44-8f0a-141e744f6b27 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:15.945867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:15.946515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:15.946796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:15.947070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:15.947883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:15.948188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:15.949538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aa589-8705-4ad9-a44f-b42c55fd47c6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:15.957342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 595/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Mon May 23 15:16:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:18.142140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5f71-ae74-42f9-bc36-da0925a87d22 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:18.142640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5f71-ae74-42f9-bc36-da0925a87d22 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:18.142640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5f71-ae74-42f9-bc36-da0925a87d22 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:18.144003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 572/1167] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:18.150077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953140-c5c6-4c95-a760-4db467113627 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:18.150513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953140-c5c6-4c95-a760-4db467113627 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:18.150642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de953140-c5c6-4c95-a760-4db467113627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:18.167548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-de953140-c5c6-4c95-a760-4db467113627 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:18.168738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-de953140-c5c6-4c95-a760-4db467113627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:18.234373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 596/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:18.257434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5f71-ae74-42f9-bc36-da0925a87d22 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:18.311286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:18.359911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5f71-ae74-42f9-bc36-da0925a87d22 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:18.392535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:18.393118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:18.393402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:18.393680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:18.394412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:18.395822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b1424-e998-4eab-8f6e-ec127510f243 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:18.409664 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 573/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Mon May 23 15:16:18 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:16:20.704045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b34e4-c5be-42c8-81bb-34abd63f59a0 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:20.704604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b34e4-c5be-42c8-81bb-34abd63f59a0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:20.704604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b34e4-c5be-42c8-81bb-34abd63f59a0 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:20.705983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 597/1170] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:20.711282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:20.711718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:20.711891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:20.729320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:20.730491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:20.795340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 574/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:20.818273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b34e4-c5be-42c8-81bb-34abd63f59a0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:20.838073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:20.919577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b34e4-c5be-42c8-81bb-34abd63f59a0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:20.953422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:20.954518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:20.954751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:20.955030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] PATH_INFO: `/v3/domains/8d2c42ac3fa141a7816b33c55847fbf1` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:20.966446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8d2c42ac3fa141a7816b33c55847fbf1)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:20.967950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59005381-2af6-42c4-8d20-9a759888e752 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:20.969694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 598/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Mon May 23 15:16:20 2022] GET /identity/v3/domains/8d2c42ac3fa141a7816b33c55847fbf1 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:20.975664 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:21.033951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:21.090966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efd753-30e2-45f3-b170-7a9f51cca138 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:21.124057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:21.125239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:21.125525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:21.125804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:21.126519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:21.128002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ea6c9-540b-49bc-a689-fd1881630754 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:21.152775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 575/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:16:20 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:16:23.361427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130066-d046-4adc-ab85-817a63647492 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:23.361984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130066-d046-4adc-ab85-817a63647492 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:23.361984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130066-d046-4adc-ab85-817a63647492 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:23.363343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 599/1174] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:23.368625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:23.369017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:23.369186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:23.386461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:23.387655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:23.454062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 576/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:23.478916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130066-d046-4adc-ab85-817a63647492 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:23.557408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:23.580269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130066-d046-4adc-ab85-817a63647492 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:23.612875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:23.613657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:23.613933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:23.614203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] PATH_INFO: `/v3/domains/8d2c42ac3fa141a7816b33c55847fbf1` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:23.615375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8d2c42ac3fa141a7816b33c55847fbf1)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:23.616809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493222e7-89da-4600-b79a-e5041d5a0ee3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:23.618388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 600/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Mon May 23 15:16:23 2022] GET /identity/v3/domains/8d2c42ac3fa141a7816b33c55847fbf1 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:23.624753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:23.648673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:23.722037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b044a-e11d-44be-b13a-d007d58d12e6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:23.756350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:23.757009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:23.757295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:23.757568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:23.758279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:23.759754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320a45b-78e6-413d-a100-b6cb151f92a4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:23.778617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 577/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:16:23 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:16:25.997632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c307f2-43b9-471d-8272-5385853ac195 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:25.998157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c307f2-43b9-471d-8272-5385853ac195 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:25.998252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c307f2-43b9-471d-8272-5385853ac195 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.000159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 601/1178] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:26.005335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:26.005777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:26.005872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.022467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:26.023656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:26.089122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 578/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:26.112382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c307f2-43b9-471d-8272-5385853ac195 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:26.210863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c307f2-43b9-471d-8272-5385853ac195 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:26.243060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:26.243858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:26.244141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:26.244417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.254888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:26.262511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:26.263642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:16:26.265482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 602/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:26.270318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:26.282076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:26.370160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3094c9-6c0c-476f-a55a-80b612f1214c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:26.403923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:26.404579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:26.404861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:26.405181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.405928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:26.406230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:26.407628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:26.415469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 579/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:26.421329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:26.430620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:26.521160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bddc8-2384-42a2-bcb2-74dad228158d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:26.553818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:26.554665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:26.554948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:26.555222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] PATH_INFO: `/v3/users/990f9198a789472498e5d0d94b45c827` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.568568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] RBAC: Authorizing `identity:get_user(user_id=990f9198a789472498e5d0d94b45c827)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:26.569998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:26.571664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 603/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:26 2022] GET /identity/v3/users/990f9198a789472498e5d0d94b45c827 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:26.577430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:26.655449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:26.684885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719fb24-bd17-424d-8906-6c9bc7cc8de8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:26.717444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:26.718309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:26.718586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:26.718860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:26.783354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:26.784824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:26.850467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:26.880534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 580/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:16:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:16:26.886383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:26.947491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:26.985777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744952ee-e6cd-493b-9270-468f79d81c6d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:27.018844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:27.019717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:27.020000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:27.020277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] PATH_INFO: `/v3/projects/035ab696e0a44aa1bf20ed9b697f6753` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:27.021451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] RBAC: Authorizing `identity:get_project(project_id=035ab696e0a44aa1bf20ed9b697f6753)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:27.022874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de537c-2e0f-4a30-a5cb-020281f0afdb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:27.024594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 604/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:26 2022] GET /identity/v3/projects/035ab696e0a44aa1bf20ed9b697f6753 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:27.031339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:27.129565 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad026-8877-4cfa-a9d4-e10917342e05 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:27.162851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:27.163525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:27.163813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:27.164091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:27.164914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=035ab696e0a44aa1bf20ed9b697f6753, user.id=990f9198a789472498e5d0d94b45c827) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:27.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:27.166674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce829-85b3-42d7-bef3-b73e70b9d404 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:27.172706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 581/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:16:27 2022] GET /identity/v3/role_assignments?user.id=990f9198a789472498e5d0d94b45c827&scope.project.id=035ab696e0a44aa1bf20ed9b697f6753&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:29.333645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23ed07-a295-4371-9121-da0eba6f49e1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:29.334175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23ed07-a295-4371-9121-da0eba6f49e1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:29.334175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23ed07-a295-4371-9121-da0eba6f49e1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:29.335617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 605/1186] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:29.341173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:29.341581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:29.341729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:29.360114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:29.361305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:29.388712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:29.426515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 582/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:29.448324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23ed07-a295-4371-9121-da0eba6f49e1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:29.547757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23ed07-a295-4371-9121-da0eba6f49e1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:29.575617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:29.581431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:29.582212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:29.582495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:29.582772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:29.593862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:29.601371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:29.602295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:16:29.603151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 606/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:29.608561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:29.705539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb2c7-b5bd-429e-bb98-726097a4833e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:29.738882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:29.739573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:29.739861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:29.740138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:29.740879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:29.741187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:29.742564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:29.750645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 583/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:29.756593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:29.856780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783af10-aa01-426f-b1c4-e8eea56d9990 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:29.888810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:29.890267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:29.890542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:29.890816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] PATH_INFO: `/v3/users/990f9198a789472498e5d0d94b45c827` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:29.892012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] RBAC: Authorizing `identity:get_user(user_id=990f9198a789472498e5d0d94b45c827)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:29.893457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:29.895065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 607/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:29 2022] GET /identity/v3/users/990f9198a789472498e5d0d94b45c827 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:29.900886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:29.929369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:30.000785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43252445-4534-48a4-90b2-e4cc1fabf6e2 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:30.033637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:30.034810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:30.035234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:30.035682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] PATH_INFO: `/v3/projects/035ab696e0a44aa1bf20ed9b697f6753` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:30.037396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] RBAC: Authorizing `identity:get_project(project_id=035ab696e0a44aa1bf20ed9b697f6753)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:30.039672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023215f-6d71-4978-aa33-40307a159a93 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:30.042335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 584/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:29 2022] GET /identity/v3/projects/035ab696e0a44aa1bf20ed9b697f6753 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:30.048627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:30.108155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:30.148997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bdb1f-ad5a-4d71-9d7c-27dfbcc020af None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:30.181174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:30.182057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:30.182341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:30.182616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] PATH_INFO: `/v3/projects/035ab696e0a44aa1bf20ed9b697f6753/users/990f9198a789472498e5d0d94b45c827/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:30.184588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] RBAC: Authorizing `identity:create_grant(project_id=035ab696e0a44aa1bf20ed9b697f6753, user_id=990f9198a789472498e5d0d94b45c827, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:30.186558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6b906-462a-4e5c-be47-e0d766f576da None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:30.198920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 608/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:16:30 2022] PUT /identity/v3/projects/035ab696e0a44aa1bf20ed9b697f6753/users/990f9198a789472498e5d0d94b45c827/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:16:32.359486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3719-597b-43c2-80e3-835dea6271e2 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:32.360009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3719-597b-43c2-80e3-835dea6271e2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:32.360101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3719-597b-43c2-80e3-835dea6271e2 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:32.361410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 585/1193] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:16:32.366541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:32.366906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:32.367101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:32.384041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:16:32.385210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:16:32.451356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 609/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:16:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:16:32.475528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3719-597b-43c2-80e3-835dea6271e2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:32.569079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:32.576191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3719-597b-43c2-80e3-835dea6271e2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:32.610217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:32.610937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:32.611221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:32.611528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:32.621768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:16:32.629898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:16:32.630996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:16:32.631918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 586/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:16:32.637046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:32.691937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:32.739897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12403850-670d-4e6e-b90e-8812bd9a276e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:32.772860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:32.773526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:32.773814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:32.774095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:32.774837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:32.775145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:32.776546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:32.784611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 610/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:32.790473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:32.889182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df2025-e072-4fb6-810a-d84aa26d1ef7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:32.922262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:32.923110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:32.923413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:32.923690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] PATH_INFO: `/v3/users/990f9198a789472498e5d0d94b45c827` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:32.924870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] RBAC: Authorizing `identity:get_user(user_id=990f9198a789472498e5d0d94b45c827)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:32.926308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:32.927958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 587/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Mon May 23 15:16:32 2022] GET /identity/v3/users/990f9198a789472498e5d0d94b45c827 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:32.933843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:33.032224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d386ef-7c94-44b7-96bc-40841cc0cbcc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:33.044513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:33.065883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:33.066549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:33.066836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:33.067114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:33.132277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:33.133739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:33.228332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 611/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:16:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:16:33.234697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:33.259115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:33.332866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c343c-2de8-4bdb-ab15-3a7585487863 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:33.366947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:33.367824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:33.368107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:33.368381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] PATH_INFO: `/v3/projects/035ab696e0a44aa1bf20ed9b697f6753` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:33.369547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] RBAC: Authorizing `identity:get_project(project_id=035ab696e0a44aa1bf20ed9b697f6753)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:33.370990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89049c4-7c69-478a-b7e8-4b17aaba06e6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:33.372696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 588/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Mon May 23 15:16:33 2022] GET /identity/v3/projects/035ab696e0a44aa1bf20ed9b697f6753 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:33.379012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:16:33.393569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:33.477808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebd612-fd01-4e07-a0e3-d3af0c363602 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:16:33.510144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:16:33.510729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:16:33.511015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:16:33.511293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:16:33.512143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=035ab696e0a44aa1bf20ed9b697f6753, user.id=990f9198a789472498e5d0d94b45c827) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:16:33.512453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:16:33.513868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcffe9-af73-44c8-ac53-9c625e11d582 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:16:33.520210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 612/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:16:33 2022] GET /identity/v3/role_assignments?user.id=990f9198a789472498e5d0d94b45c827&scope.project.id=035ab696e0a44aa1bf20ed9b697f6753&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:16:43.362900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=54 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:16:43.517583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=62 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:34.112476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8cc2a-11dd-42e8-8bcc-59671a9c0c3e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:34.113052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8cc2a-11dd-42e8-8bcc-59671a9c0c3e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:34.113243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8cc2a-11dd-42e8-8bcc-59671a9c0c3e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:34.115210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 589/1201] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:17:34.121699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:34.122238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:34.122446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:34.144686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:34.146034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:34.236371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 613/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:34.266062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8cc2a-11dd-42e8-8bcc-59671a9c0c3e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:34.403306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8cc2a-11dd-42e8-8bcc-59671a9c0c3e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:34.454019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:34.454979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:34.455301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:34.455717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:34.473495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:34.475178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:34.496953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:34.498064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:34.499031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:34.499031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:34.499031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:34.499031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:34.503406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 590/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:34.504989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:34.648580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f358b-614e-4176-bc76-9daafd1bee87 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:34.689632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:34.698340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:34.699017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:34.699636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:34.699828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:34.700542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:34.700919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:34.702273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968f9ee-da31-460a-a712-2fda80c8fc56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:34.716690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 614/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:34.724133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:34.814519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:34.888056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8fbcb9-d2f8-444f-9e50-cdba0a49a236 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:34.934436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:34.935140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:34.935457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:34.935740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:34.936454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:34.938060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e96b40-b8c3-4d65-ac76-fa2d3bd23b6d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:34.971835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 591/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Mon May 23 15:17:34 2022] POST /identity/v3/users => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:17:37.523670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba232ec-0253-4543-a980-ef9132aa1d09 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:37.524263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba232ec-0253-4543-a980-ef9132aa1d09 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:37.524263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba232ec-0253-4543-a980-ef9132aa1d09 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:37.525794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 615/1206] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:17:37.532101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:37.532599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:37.532682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:37.552011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:37.553472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:37.639017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 592/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:37.663020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba232ec-0253-4543-a980-ef9132aa1d09 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:37.788866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba232ec-0253-4543-a980-ef9132aa1d09 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:37.831690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:37.832701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:37.832855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:37.833123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:37.845479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:17:37.856170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:37.857626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:37.858623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 616/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:17:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:37.864343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:37.916615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:37.995334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1bbc8-6013-4d0c-9d4a-70164b8d88c9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.035056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:38.035777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:38.036141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:38.036341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:38.037094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:38.037399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:38.038949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:38.050456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 593/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:17:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:38.056651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:38.119085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:38.177563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e793d7-d3fe-4532-a01e-000b23615688 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.220354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:38.221201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:38.221486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:38.221762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:38.235462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:38.237354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:38.256950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:38.257944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:38.259441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:38.259441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:38.259441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:38.259441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:38.259441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 617/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:17:38.264820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:38.385278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:38.389197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581776d-77d1-4807-a6cd-a3c1f037f23b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.432716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:38.432716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:38.432716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:38.432716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:38.433281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:38.433719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:38.435233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:38.449131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 594/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:38.454691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:38.569341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293c0c-bf38-45ac-867f-78412f1e6d94 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.571288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:38.618148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:38.618971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:38.619257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:38.619572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:38.629935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:38.631890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:17:38.647955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:38.649570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:38.650545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 618/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:38.655379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:38.770000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed9325-1549-40c3-a68c-82dc7e5bf7a7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.815531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:38.816704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:38.816704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:38.816893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:38.817601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:38.817907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:38.819342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:38.838358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 595/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:17:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:38.844378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:38.961077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e05d-e92c-443d-8199-3b267dab09d9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:38.999930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:39.000581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:39.000899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:39.001132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:39.041660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:39.093572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:39.095044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:39.211950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 619/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:17:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:17:39.218147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:39.241997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:39.348100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea541f1a-7e6b-4df5-8ff5-b5cd3e1d77e4 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:39.390943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:39.392017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:39.392426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:39.392809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:39.405716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:39.407196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:39.431471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:39.432470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:39.433383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:39.433383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:39.433383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:39.433383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:39.434220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 596/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:17:39.439673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:39.508615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:39.553122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120b2cb-976c-4045-a5fe-1f46be438c8a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:39.590518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:39.591202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:39.591472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:39.591761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:39.592491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:39.592804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:39.594226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:39.613651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 620/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:39.622644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:39.711386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:39.746756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8caa5c-95db-4938-8ff4-bcd5924b2171 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:39.783394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:39.784121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:39.784405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:39.784677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:39.792650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:39.794510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:17:39.810495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:39.811539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:39.812465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 597/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:39.818695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:39.940366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26318f1f-8fc4-4802-8105-6182cfc9d734 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:39.968325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:39.983202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:39.983912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:39.984206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:39.984518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:39.985399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:39.985763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:39.987213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e125a-7ffe-4954-ae55-f910989f73d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:40.001474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 621/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:17:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:40.009138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:40.120214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768c974-30eb-49f7-af7a-3b222628660c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:40.152420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:40.159584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:40.160259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:40.160547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:40.160826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:40.161662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=5dc27c2736384fdd91fad3d94422807b) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:40.161979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:40.163479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7526bd-57f0-4e7c-853b-c024754e22ef None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:40.170906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 598/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:17:40 2022] GET /identity/v3/role_assignments?user.id=5dc27c2736384fdd91fad3d94422807b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:42.510201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563061-1253-4c93-ae6d-4594e8eb47dc None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:42.510993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563061-1253-4c93-ae6d-4594e8eb47dc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:42.510993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563061-1253-4c93-ae6d-4594e8eb47dc None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:42.512138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 622/1220] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:17:42.517987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:42.518476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:42.518580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:42.535402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:42.536619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:42.611026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 599/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:42.642383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563061-1253-4c93-ae6d-4594e8eb47dc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:42.763118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563061-1253-4c93-ae6d-4594e8eb47dc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:42.801319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:42.802153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:42.802444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:42.802822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:42.818373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:17:42.826237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:42.827241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:42.828189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 623/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:17:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:42.833503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:42.943981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a9e57-05f1-4dab-8a8b-cf77a741bb8c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:42.970404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:42.982628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:42.983297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:42.983622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:42.983935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:42.984679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] RBAC: Adding query filter params (name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:42.984982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:42.986352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:42.999282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 600/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:17:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:17:43.000561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:43.054630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:43.119726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655afc9d-d891-42d1-a81a-33a509270991 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:43.157466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:43.158267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:43.158589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:43.158820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:43.169929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:43.171441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:43.188578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:43.189564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:43.190571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:43.190571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:43.190571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:43.190571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:43.190571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 624/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:43.195536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:43.319491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966388d-5bca-433b-9061-faf75e80777b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:43.360536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:43.361250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:43.361531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:43.361814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:43.362517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:43.362820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:43.364229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:43.377001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 601/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:17:43.382585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:43.480580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:43.487963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fba0e-649e-4759-9cd2-5a80be0ae413 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:43.525163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:43.525978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:43.526268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:43.526549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:43.534189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:43.535663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:17:43.550546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:43.551753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:43.553256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 625/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:43.557649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:43.609356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:43.669583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45602-808b-4471-8e5b-cbcb63bb8f7e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:43.707093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:43.707937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:43.708255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:43.708573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:43.709871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:43.710202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:43.712049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:43.735473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 602/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:17:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:17:43.740852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:43.862895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429e901-f9eb-4edb-8fbc-d0eafceb6a8f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:43.897759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:43.898601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:43.898891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:43.899170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:43.912066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:43.913651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:43.932727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:43.934128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:43.935029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:43.935029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:43.935029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:43.935029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:43.935029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 626/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:43.939969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:44.052294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0a9e-16e1-4e18-890b-dfcdd2515402 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:44.055404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:44.091627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:44.092377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:44.092707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:44.092961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:44.093780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:44.094120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:44.095584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:44.111143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 603/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:44.117300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:44.127645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:44.231975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a70cf7-1051-4e33-b67d-cec4ec2f3b5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:44.278759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:44.279659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:44.279941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:44.280213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:44.287237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:44.288710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:17:44.303987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:44.305107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:44.306413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 627/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:44.311934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:44.430561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac165f5-759e-415c-9bf4-550a53144240 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:44.472575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:44.473339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:44.473628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:44.473904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:44.474778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:44.475112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:44.476886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad5ddd-0075-406e-a0e8-752a29bea040 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:44.491625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 604/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:44.499188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:44.575473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:44.615039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda4d3e-5b03-4bf9-85cc-073e4cb41966 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:44.652394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:44.653381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:44.653741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:44.654105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/5dc27c2736384fdd91fad3d94422807b/roles/759ac5c57bcf413dba83351403925c0b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:44.669555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=5dc27c2736384fdd91fad3d94422807b, role_id=759ac5c57bcf413dba83351403925c0b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:44.670996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db4ced-2fb5-402a-a886-6a6368556733 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:44.684450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 628/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:17:44 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/5dc27c2736384fdd91fad3d94422807b/roles/759ac5c57bcf413dba83351403925c0b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:17:47.110029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7333f-1967-463c-bea8-8f2924a2c27b None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.110602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7333f-1967-463c-bea8-8f2924a2c27b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.110602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7333f-1967-463c-bea8-8f2924a2c27b None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.112468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 605/1233] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:17:47.117853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.118339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.118456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.137960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:47.139335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:47.219447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 629/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:47.242510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7333f-1967-463c-bea8-8f2924a2c27b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:47.270255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:47.353713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7333f-1967-463c-bea8-8f2924a2c27b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:47.392062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:47.392789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.393075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.393349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.404041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:17:47.411752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:47.412734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:47.413792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 606/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Mon May 23 15:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:47.419713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:47.469171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:47.538684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dd256-4f00-4b01-aaa6-3f2c921ee4e2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:47.581548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:47.582189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.582471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.582802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.583539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:47.583870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:47.585234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:47.595096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 630/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Mon May 23 15:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:47.601035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:47.707927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:47.728045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddad0c-8b33-455a-beea-57d8f866486c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:47.766842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:47.767772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.768072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.768343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.780291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:47.781743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:47.801755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:47.802937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:47.804177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:47.804177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:47.804177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:47.804177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:47.804177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 607/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:47.813658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:47.934186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fd37f-8a8c-4960-bda7-39a34e5ba48f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:47.943634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:47.971962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:47.972632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:47.972969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:47.973270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:47.973981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:47.974279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:47.975733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:47.987896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 631/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:47.993518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:48.110845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05541728-6979-4c91-b77c-65370fc5a97b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:48.146296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:48.147091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:48.147390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:48.147667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:48.150364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:48.156024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:48.157506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:17:48.172447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:48.173720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:48.174675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 608/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:48.179807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:48.293500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa90478-9f1a-4216-a48d-c0b328906f31 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:48.331193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:48.332095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:48.332486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:48.332763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:48.333596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:48.333901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:48.335315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:48.353999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 632/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:17:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:48.360470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:48.474873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c599d8-40fb-4335-829e-528f13857633 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:48.513395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:48.514049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:48.514333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:48.514608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:48.584559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:48.593400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:48.595107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:48.708903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 609/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:17:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:17:48.715793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:48.745576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:48.829500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee592cf-711b-44e1-9137-1625ba883c18 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:48.868946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:48.869851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:48.870205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:48.870487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:48.882961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:48.884875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:48.904077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:48.905134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:48.906201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:48.906201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:48.906201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:48.906201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:48.906201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 633/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:17:48.911211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:49.017723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:49.025144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92f386-3d71-4d63-92bd-857d6cc5bad5 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:49.065464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:49.066124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:49.066410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:49.066738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:49.067614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:49.067921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:49.069478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:49.082309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 610/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:49.088553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:49.176348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:49.201625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311ea0c-acbc-4227-b7e4-d5c6feb807f0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:49.242870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:49.243787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:49.244105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:49.244395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:49.252659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:49.254300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:17:49.267918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:49.268989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:49.270092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:49.273895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 634/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:17:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:17:49.275022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:49.390365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53184aa6-9f4f-4533-a933-440792fea85c None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:49.432217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:49.432838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:49.433124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:49.433939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:49.434728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:49.435044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:49.436664 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab80e2e-7638-4481-9285-3786a1714ad5 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:49.450996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 611/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:49.457314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:49.563899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a29b-1840-4839-9307-8bfb28d01470 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:49.604906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:49.605785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:49.606169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:49.606494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:49.607577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] RBAC: Adding query filter params (role.id=759ac5c57bcf413dba83351403925c0b, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=5dc27c2736384fdd91fad3d94422807b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:49.607949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:49.609898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d376d9-1c46-4b0a-9b51-1a29bf6d8b65 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:49.625596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 635/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:17:49 2022] GET /identity/v3/role_assignments?user.id=5dc27c2736384fdd91fad3d94422807b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=759ac5c57bcf413dba83351403925c0b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:52.037949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403953fd-b305-4dd3-8886-161b346361dd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.038527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403953fd-b305-4dd3-8886-161b346361dd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.038527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403953fd-b305-4dd3-8886-161b346361dd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.040330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 612/1247] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:17:52.046484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.047024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.047024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.052065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:52.064449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:52.065643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:52.143094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 636/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:52.166578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403953fd-b305-4dd3-8886-161b346361dd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:52.184964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:52.284570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403953fd-b305-4dd3-8886-161b346361dd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:52.319530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:52.320371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.320663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.320933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.334112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:17:52.342368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:52.343604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:52.344560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 613/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:52.349615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:52.457714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86ee15-9c13-43ef-b9b7-b45688a641ef None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:52.496807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:52.502419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:52.503089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.503386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.503685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.504433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:52.504735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:52.506090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:52.516165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 637/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:52.522259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:52.611814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:52.639895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aeefe-8ae1-4fb1-850f-1a96f5b2cc2a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:52.680358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:52.681166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.681451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.681734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.694568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:52.696198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:52.714294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:52.716327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:52.717376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:52.717376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:52.717376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:52.717376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:52.717376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 614/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 23 15:17:52.722351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:52.843201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585873-cc66-4944-a7aa-9a8aa0084299 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:52.881427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:52.882121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:52.882407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:52.882683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:52.883461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:52.883757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:52.885193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:52.898377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 638/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:52.904576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:53.013433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf174d9a-d9d1-4e2e-a439-6348318ef763 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:53.042051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:53.051255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:53.052139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:53.052423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:53.052702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:53.061162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:53.062669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:17:53.078386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:53.079442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:53.080397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 615/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:53.085557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:53.145137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:53.193118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a20fb-3e89-4c56-b674-300bf760556d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:53.230078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:53.231044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:53.231331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:53.231643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:53.232509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:53.232823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:53.234292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:53.253998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 639/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:17:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:53.259666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:53.363620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd82288-e63b-4a7a-bccd-fb9fdcd0243a None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:53.397592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:53.398238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:53.398520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:53.398794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:53.463939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:53.480473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:53.482188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:53.587328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 616/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:17:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:17:53.593290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:53.702734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afc07-1845-4838-9d91-a008781f41ac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:53.716279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:53.737539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:53.738317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:53.738600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:53.738874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:53.749489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:53.750929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:53.767963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:53.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:53.769951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:53.769951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:53.769951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:53.769951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:53.769951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 640/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:53.774861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:53.863033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:53.875848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f153e-9d3a-430c-839e-495e3d450d4b None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:53.908443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:53.909094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:53.909372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:53.909643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:53.910354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:53.910657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:53.912054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:53.923563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 617/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:53.929318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:54.026510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a76620-c4e0-4d66-8115-b151dfc59ed6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:54.060232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:54.061008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:54.061290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:54.061565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:54.068014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:54.069452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:17:54.082916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:54.083993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:17:54.085131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 641/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:54.090665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:54.189528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739f6c0-5c42-4435-a1a3-db1d49a0c5c7 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:54.222654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:54.223297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:54.223598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:54.223868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:54.224636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:54.224938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:54.226514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fea56-91db-46e8-bb76-dd53dfb680ac None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:54.239431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 618/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:54.245698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:54.270524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:54.343971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586d05b-6202-4f9d-9f41-e6829effd013 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:54.376335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:54.376976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:54.377258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:54.377530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:54.378345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=5dc27c2736384fdd91fad3d94422807b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:54.378651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:54.380091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc95903-68d8-4e90-aa93-e03d6c08d368 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:54.385368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 642/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:17:54 2022] GET /identity/v3/role_assignments?user.id=5dc27c2736384fdd91fad3d94422807b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:56.565277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f898-3a1d-444c-b5e6-71de30f1ad13 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:56.565844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f898-3a1d-444c-b5e6-71de30f1ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:56.565844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f898-3a1d-444c-b5e6-71de30f1ad13 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:56.567190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 619/1261] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:17:56.572274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:56.572645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:56.572833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:56.590493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:17:56.591688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:17:56.666948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 643/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:17:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:17:56.691511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f898-3a1d-444c-b5e6-71de30f1ad13 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:56.702961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:56.792311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f898-3a1d-444c-b5e6-71de30f1ad13 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:56.826016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:56.826797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:56.827076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:56.827345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:56.837480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:17:56.845834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:56.846951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:56.848016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 620/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:56.852887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:56.870973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:56.951278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ea033-20ac-4404-a4f2-88e7e5ee8de6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:56.984138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:56.984798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:56.985086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:56.985366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:56.986110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:56.986418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:56.987807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:56.995685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 644/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:57.001882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.066441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:57.100626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3fadc-18dc-49f1-95fc-54af6f9ecd31 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.132989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.133761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.134042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.134313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.145013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.146450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:57.162951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:57.164023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:57.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:57.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:57.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:57.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:57.165230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 621/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:57.170067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.250203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:57.269626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ca072-29cc-4f8b-965b-d81255c59295 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.301841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.302483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.302764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.303037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.303777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:57.304078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.305441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.317827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 645/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:57.323259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.426536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44470b-1457-46e5-94fd-89d2ea3bf78f None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.445736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:57.459984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.460775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.461058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.461332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.469086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.470528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:17:57.485449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:57.486562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:57.487887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 622/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:57.492372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.588948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d0aef-d00d-4213-ac75-ce0aacce4c0a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.624882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.625585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.625940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.626167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.627074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:57.627477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.628977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.638429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:57.647475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 646/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:57.653198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.751496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2a208-2ab9-4bbe-9b8e-e6ab62dbcee8 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.784287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.785061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.785344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.785617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.796839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.798306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:17:57.815644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:57.816723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:57.817694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:17:57.817694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:17:57.817694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:17:57.817694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:57.817694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 623/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:57.822388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:57.922278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791edcc-ebaa-45f3-8c02-6c2de1244ff2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:57.956456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:57.957113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:57.957401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:57.957683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:57.958558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:57.958874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:57.960283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:57.971628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 647/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:57.977210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:58.008686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:58.078296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aafe81-2edb-49d9-bd4e-15bd00c94150 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:58.112336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:58.113122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:58.113401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:58.113673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:58.120116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:58.122371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:17:58.136340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:17:58.137585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:17:58.138827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 624/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:17:58.143254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:58.199955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:58.240559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88583613-8f6f-40f0-a1ae-d2fb41bb6bb9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:58.272579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:58.273170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:58.273449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:58.273723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:58.274497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:17:58.274801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:58.276237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc1861-1443-448e-9cf1-9df9fc44a60b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:58.287742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 648/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:17:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:17:58.294332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:17:58.383275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:17:58.392233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800af20-24d2-45f7-b3b4-0f7b607f3f8e None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:17:58.425398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:17:58.426276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:17:58.426560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:17:58.426836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] PATH_INFO: `/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/5dc27c2736384fdd91fad3d94422807b/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:17:58.428817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfda9836ff164040afec83b0a7c9cb4c, user_id=5dc27c2736384fdd91fad3d94422807b, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:17:58.430255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d62d46-7778-4655-a36d-6a42a1b3742e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:17:58.443497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 625/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Mon May 23 15:17:58 2022] PUT /identity/v3/projects/dfda9836ff164040afec83b0a7c9cb4c/users/5dc27c2736384fdd91fad3d94422807b/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:18:00.602486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9061da-43df-4d39-8e36-b64ceecc1dd9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:00.603020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9061da-43df-4d39-8e36-b64ceecc1dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:00.603020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9061da-43df-4d39-8e36-b64ceecc1dd9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:00.604448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 649/1274] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:18:00.611071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:00.611585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:00.611761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:00.631715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:18:00.633063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:18:00.709203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 626/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:18:00.733748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9061da-43df-4d39-8e36-b64ceecc1dd9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:00.832733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9061da-43df-4d39-8e36-b64ceecc1dd9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:00.850417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:00.868419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:00.869149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:00.869433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:00.869710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:00.880698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 23 15:18:00.888267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:00.889385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:00.890368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 650/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Mon May 23 15:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:00.895518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:00.975621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:00.995055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb53d9e-c32d-422b-a5a6-0e8e31c485af None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.028500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.029168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.029453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.029731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.030474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:01.030783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.032191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.040118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 627/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Mon May 23 15:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:01.046439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:01.144861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7605d-acba-40e7-8feb-e2caf466ee45 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.178148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.178929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.179210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.179512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.189348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.190793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:18:01.208234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:01.209295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:01.210428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:18:01.210428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:18:01.210428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:18:01.210428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:01.210428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 651/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:01.216005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:01.313535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8cfdd-de2d-4ebf-be45-8cf8284275ed None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.346995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.347671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.347956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.348232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.348947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:01.349254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.350629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.362998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 628/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:01.368547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:01.407148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:01.475691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845b0dd-5aaa-4bb1-a5fd-da92945b7306 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.509252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.510052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.510322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.510589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.518423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.519884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 23 15:18:01.534551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:01.535721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:01.536743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 652/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:18:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:01.541568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:01.545709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:01.644511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5a341-69c9-4bd7-a78b-8590edd08c61 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.677397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.677999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.678277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.678547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.679392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:01.679698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.681113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.698082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 629/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Mon May 23 15:18:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:01.704510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:01.791428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:01.801802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44621532-19d3-4571-a829-2e7ea9e02596 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:01.835944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:01.836626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:01.837170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:01.837451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:01.903138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:01.904652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:01.991058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:02.002065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 653/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Mon May 23 15:18:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 23 15:18:02.007883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:02.067353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:02.104375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e99fa3-f582-460a-9d9d-c161882adb6d None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:02.138328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:02.139105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:02.139409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:02.139687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:02.149420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:02.150866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 23 15:18:02.168398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:02.169452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:02.170576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 23 15:18:02.170576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 23 15:18:02.170576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 23 15:18:02.170576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:18:02.170576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 630/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:02.175197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:02.272215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca01398-d143-43d0-ba74-bfd20e05a2d6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:02.307658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:02.308343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:02.308635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:02.308916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:02.309644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:02.309948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:02.311309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:02.323459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 654/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Mon May 23 15:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:18:02.330260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:02.430671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ceb1-f3c4-43a0-8ddd-ded687917ee6 None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:02.445250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:02.469436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:02.470241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:02.470526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:02.470803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:02.477671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:02.479630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(project_id) May 23 15:18:02.495585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application with Lock( May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:02.497243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: ERROR keystone.server.flask.application May 23 15:18:02.498410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 631/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Mon May 23 15:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:02.502749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:02.557679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:02.614567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2816f-4d9c-4800-8800-fa12d8cfa55b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:02.653538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:02.654205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:02.654489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:02.654765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:02.655575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:02.655894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:02.657327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1a80-8796-4ee2-8719-cadc67e9e47f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:02.670463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 655/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Mon May 23 15:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:02.676700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:02.786467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d53589-bcb5-4ff8-8b4a-6ceaf780e8fd None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:02.826755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:02.827445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:02.827724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:02.827995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:02.828823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] RBAC: Adding query filter params (role.id=a6b7c59e454546879b7d1558ef6fb0ee, scope.project.id=dfda9836ff164040afec83b0a7c9cb4c, user.id=5dc27c2736384fdd91fad3d94422807b) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:02.829132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:02.830571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b5605-3334-4abf-bedf-a30314b677dc None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:02.836724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 632/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Mon May 23 15:18:02 2022] GET /identity/v3/role_assignments?user.id=5dc27c2736384fdd91fad3d94422807b&scope.project.id=dfda9836ff164040afec83b0a7c9cb4c&role.id=a6b7c59e454546879b7d1558ef6fb0ee => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:05.057522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df5c08-8fa6-4690-8f0d-d9dcf7735c4c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:05.058074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df5c08-8fa6-4690-8f0d-d9dcf7735c4c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:05.058074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df5c08-8fa6-4690-8f0d-d9dcf7735c4c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:05.059598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 656/1288] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:18:05.064730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:05.065109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:05.065294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:05.082516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:18:05.083676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:18:05.113085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:05.150573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 633/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:18:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:18:05.173201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df5c08-8fa6-4690-8f0d-d9dcf7735c4c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:05.271610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df5c08-8fa6-4690-8f0d-d9dcf7735c4c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:05.282380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:05.305559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:05.306350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:05.306635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:05.306915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:05.307596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:05.309568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:05.321292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:05.322509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:05.323625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 657/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:18:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:05.329133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:05.425223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d51ed-0efd-46bb-9244-1de936fee21c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:05.460837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:05.461489 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:05.461770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:05.462300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:05.463006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:05.463311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:05.464780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88dfa-ff8a-4d4d-b8ee-efd59126bada None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:05.469598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 634/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 15:18:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:05.475252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:05.573451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e58-dc15-499d-8a5f-fd430f554ca3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:05.607906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:05.608565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:05.608851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:05.609122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:05.609827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:05.610126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:05.611525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f36e2-bddd-4918-9917-be7e86e3de05 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:05.616154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 658/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 15:18:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:07.795636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6552-113b-4dcf-803e-705e7397b064 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:07.796169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6552-113b-4dcf-803e-705e7397b064 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:07.796169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e6552-113b-4dcf-803e-705e7397b064 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:07.797541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 635/1293] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:18:07.802812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a134-74cf-40c5-a84a-7642486ec618 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:07.803230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a134-74cf-40c5-a84a-7642486ec618 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:07.803404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a134-74cf-40c5-a84a-7642486ec618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:07.819996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ba51a134-74cf-40c5-a84a-7642486ec618 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:18:07.821197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ba51a134-74cf-40c5-a84a-7642486ec618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:18:07.851514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:07.899187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 659/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:18:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:18:07.922029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e6552-113b-4dcf-803e-705e7397b064 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:07.953049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:08.022314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e6552-113b-4dcf-803e-705e7397b064 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:08.055494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:08.056086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:08.056374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:08.056652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:08.057368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:08.058872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62089e1e-50ca-4d0a-b297-143a5d20d870 None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:08.071324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 636/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Mon May 23 15:18:07 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:18:10.274026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728e7c-ef4d-40b0-ad63-aa41b741660e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.274588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728e7c-ef4d-40b0-ad63-aa41b741660e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.274588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728e7c-ef4d-40b0-ad63-aa41b741660e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.276010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 660/1296] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:18:10.281924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.282337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.282485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.299061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:18:10.300290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:18:10.371782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 637/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:18:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:18:10.394467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728e7c-ef4d-40b0-ad63-aa41b741660e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:10.493609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728e7c-ef4d-40b0-ad63-aa41b741660e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:10.525421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:10.526141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.526421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.526695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.527872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:10.529237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:10.540793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:10.542026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:10.543507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 661/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:18:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:10.548457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:10.566647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:10.656638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a22a75-f84d-4d04-8cca-9ef01bf2de38 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:10.691272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:10.691962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.692249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.692527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.693239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:10.693550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:10.694934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:10.700037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 638/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 15:18:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:10.706041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:10.738717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:10.806343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20852ed-b0a1-4db5-9647-a39f72efe694 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:10.842734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:10.843413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.843708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.843985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.844773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] RBAC: Adding query filter params (interface=public, service_id=8913e03b3f194005af3270643a8896e2, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:10.845088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:10.846449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56955c45-1ede-4532-9668-1ff4c5463201 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:10.851432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 662/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Mon May 23 15:18:10 2022] GET /identity/v3/endpoints?service_id=8913e03b3f194005af3270643a8896e2&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:10.857518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:10.938415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:10.957161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b2a9-3e4e-4c39-983a-ce6d54ed04ca None admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:10.990774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:10.991455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:10.991745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:10.992024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:10.992706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:10.994157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78ce47-f9f5-4785-8718-25740f23372e None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:11.001656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 639/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Mon May 23 15:18:10 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:18:13.197733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee462-85f1-49c0-a086-27d2c06fc77a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:13.198300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee462-85f1-49c0-a086-27d2c06fc77a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:13.198300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee462-85f1-49c0-a086-27d2c06fc77a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:13.199603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 663/1302] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:18:13.204835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:13.205280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:13.205387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:13.222157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:18:13.223339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:18:13.289114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 640/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:18:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 23 15:18:13.312599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee462-85f1-49c0-a086-27d2c06fc77a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:13.404276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:13.411160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deee462-85f1-49c0-a086-27d2c06fc77a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:13.444470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:13.445254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:13.445538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:13.445813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:13.446467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:13.447917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 23 15:18:13.459700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 23 15:18:13.460928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 23 15:18:13.462020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 664/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Mon May 23 15:18:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 23 15:18:13.467674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:13.544098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:13.566719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a0711-010d-4ebc-837c-2184fe152db4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:13.600288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:13.600947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:13.601231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:13.601506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] PATH_INFO: `/v3/services` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:13.602209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:18:13.602516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:13.603941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2664a9-42d9-4de9-8297-a8e9f76ba7eb None admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:13.609612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 641/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Mon May 23 15:18:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:18:13.615475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:18:13.713651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0261a0-ca17-4cdd-8af6-b6864b07615f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:18:13.747113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:18:13.747792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:18:13.748217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:18:13.748501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:18:13.749231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:18:13.750569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a3606-35de-4437-9113-0279d47763ae None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:18:13.768172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 665/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Mon May 23 15:18:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:18:23.607138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=30 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:18:23.764000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:17.174446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316d85-8eb0-4912-a7f1-594ce8a4ef11 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:17.175020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316d85-8eb0-4912-a7f1-594ce8a4ef11 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:17.175020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316d85-8eb0-4912-a7f1-594ce8a4ef11 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:17.179755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 642/1307] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:17.181745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5066-c898-4225-bd2d-e3ad145e3257 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:17.182163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5066-c898-4225-bd2d-e3ad145e3257 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:17.182373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5066-c898-4225-bd2d-e3ad145e3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:17.277372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-208e5066-c898-4225-bd2d-e3ad145e3257 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:17.278666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-208e5066-c898-4225-bd2d-e3ad145e3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:17.407683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 666/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:17.458946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:17.459271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:17.459596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:17.461103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 643/1309] 10.222.0.46 () {54 vars in 964 bytes} [Mon May 23 15:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:17.476355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14707-3f53-48d0-bb93-82e34f3d5e4f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:17.476836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14707-3f53-48d0-bb93-82e34f3d5e4f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:17.477246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d14707-3f53-48d0-bb93-82e34f3d5e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:17.598315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-37d14707-3f53-48d0-bb93-82e34f3d5e4f None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:17.600250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-37d14707-3f53-48d0-bb93-82e34f3d5e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:17.631961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:17.713321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 667/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Mon May 23 15:19:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:19:17.729053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:17.735387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:17.870026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e8d53-5892-4b18-aae0-c54d7c6a4492 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:17.960064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:17.960672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:17.960948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:17.961230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:17.962886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:18.023533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:18.086083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:18.101378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726351cc-4afd-44d1-8664-84648c1da462 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:18.119079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 644/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:20.608519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:20.609354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:20.609354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:20.614308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 668/1312] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:20.616330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5739-9ba1-4933-aa84-e8c0c4562765 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:20.617090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5739-9ba1-4933-aa84-e8c0c4562765 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:20.617090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5739-9ba1-4933-aa84-e8c0c4562765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:20.731412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cbbe5739-9ba1-4933-aa84-e8c0c4562765 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:20.733236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cbbe5739-9ba1-4933-aa84-e8c0c4562765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:20.846338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 645/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:20.884595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:20.886132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:20.999622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3b1c5-178b-47ca-92fa-cf751751bde3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:21.075226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:21.078122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:21.078777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:21.079059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:21.079336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:21.081606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:21.198361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:21.199950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2ade1-cd3c-4a63-b009-eda5305bf9bf service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:21.220279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 669/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:23.801536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:23.802116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:23.802116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:23.803490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 646/1315] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:19:23.808916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90115d-0d0e-49ba-abc8-f6c2bc96271d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:23.809362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90115d-0d0e-49ba-abc8-f6c2bc96271d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:23.809467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90115d-0d0e-49ba-abc8-f6c2bc96271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:23.873719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7e90115d-0d0e-49ba-abc8-f6c2bc96271d None None] MFA Rules not processed for user `e16507240f7444d284829a7f1b8c20db`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:23.874906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7e90115d-0d0e-49ba-abc8-f6c2bc96271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:23.925432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:23.970782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 670/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:24.012745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:24.015014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:24.024815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:24.117620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1921660-2ea5-4497-b6c4-e5ba088f1805 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:24.190928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:24.191602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:24.191888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:24.192165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:24.193822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:24.266626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:24.315599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:24.317160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c504ec-9f70-4728-8f34-0ba2e420eaac service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:24.336198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 647/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:27.110823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:27.111351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:27.111351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:27.112748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 671/1318] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:27.117927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040394-d6b3-44d8-92b7-0707abe74cc9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:27.118349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040394-d6b3-44d8-92b7-0707abe74cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:27.118480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42040394-d6b3-44d8-92b7-0707abe74cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:27.182308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-42040394-d6b3-44d8-92b7-0707abe74cc9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:27.183524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-42040394-d6b3-44d8-92b7-0707abe74cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:27.281985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 648/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:27.324372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:27.325952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:27.427815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e127-1c08-46ec-aa07-abd3bd68e227 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:27.499962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:27.500603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:27.500886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:27.501162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:27.502772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:27.509996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:27.611953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:27.613256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2014897-a097-4f9e-ac33-d4342c547509 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:27.637594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 672/1320] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:30.538724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:30.539262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:30.539471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:30.540910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 649/1321] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:30.546519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce35ea-fead-40a9-b9f7-78f0175b1ae4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:30.546944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce35ea-fead-40a9-b9f7-78f0175b1ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:30.547074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce35ea-fead-40a9-b9f7-78f0175b1ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:30.611475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-12ce35ea-fead-40a9-b9f7-78f0175b1ae4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:30.612681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12ce35ea-fead-40a9-b9f7-78f0175b1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:30.671566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:30.712404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 673/1322] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:30.748789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:30.750501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:30.770781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:30.864933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed09afd-037c-4156-8a6d-918620aaa495 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:30.945912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:30.947000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:30.947531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:30.948007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:30.950932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:31.032849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:31.077854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:31.079272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fb571-b5ee-40c6-a8d2-a5f3b256e01d service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:31.098285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 650/1323] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:33.445869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9b1-530b-44a3-883d-f0590fd1cf88 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:33.446394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9b1-530b-44a3-883d-f0590fd1cf88 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:33.446538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3e9b1-530b-44a3-883d-f0590fd1cf88 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:33.447976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 674/1324] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:33.453925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b62f1-5f81-4f44-8218-2c7e41e4cd5a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:33.454340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b62f1-5f81-4f44-8218-2c7e41e4cd5a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:33.454482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b62f1-5f81-4f44-8218-2c7e41e4cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:33.520301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9d4b62f1-5f81-4f44-8218-2c7e41e4cd5a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:33.521426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9d4b62f1-5f81-4f44-8218-2c7e41e4cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:33.619277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 651/1325] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:33.668242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:33.668541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:33.668823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:33.670323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 675/1326] 10.222.0.46 () {54 vars in 964 bytes} [Mon May 23 15:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:33.676207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d06e-b383-4447-99ee-1fd38a2e2d3a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:33.676497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d06e-b383-4447-99ee-1fd38a2e2d3a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:33.676772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91d06e-b383-4447-99ee-1fd38a2e2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:33.708638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:33.753523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1a91d06e-b383-4447-99ee-1fd38a2e2d3a None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:33.754732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1a91d06e-b383-4447-99ee-1fd38a2e2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:33.837889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 652/1327] 10.222.0.46 () {58 vars in 1061 bytes} [Mon May 23 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:19:33.847650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:33.849334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:33.968741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9913d-713f-435b-bf12-49a8dda331cf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:34.047947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:34.048610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:34.048896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:34.049176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:34.050832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:34.068270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:34.162167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:34.163549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb1037-b53d-447f-8ad8-d0c74644b813 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:34.182446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 676/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:36.740823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:36.741468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:36.741806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:36.743856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 653/1329] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:36.749692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a625a9a-8f14-4871-b164-a378667e8635 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:36.750143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a625a9a-8f14-4871-b164-a378667e8635 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:36.750224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a625a9a-8f14-4871-b164-a378667e8635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:36.816596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5a625a9a-8f14-4871-b164-a378667e8635 None None] MFA Rules not processed for user `e16507240f7444d284829a7f1b8c20db`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:36.817795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a625a9a-8f14-4871-b164-a378667e8635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:36.882892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:36.914998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 677/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:36.953759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:36.955471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:37.067335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dceff6-d8d2-4fa6-9978-c80a4b13cf6d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:37.087871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:37.143812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:37.144482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:37.144754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:37.145026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:37.146666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:37.257012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:37.258479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a2801-57bc-46ba-a7a1-842585659e7a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:37.278103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 654/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:19:39.953844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:39.954354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:39.954465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:39.955838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 678/1332] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:39.961583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ffe3-fb01-44fd-9194-eeb246355195 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:39.962023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ffe3-fb01-44fd-9194-eeb246355195 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:39.962131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ffe3-fb01-44fd-9194-eeb246355195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:40.025681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:40.028317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0766ffe3-fb01-44fd-9194-eeb246355195 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:40.029539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0766ffe3-fb01-44fd-9194-eeb246355195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:40.130555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 655/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:40.165427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:40.167039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:40.271315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db232-c9ac-4768-b8e6-c19526e8b4e3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:40.344325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:40.344909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:40.345194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:40.345472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:40.347108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:40.384686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:40.485847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:40.487342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce4f4d-6d14-42c1-872b-57836109bccc service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:40.506126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 679/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:42.766975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:42.767621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:42.767621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:42.768985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 656/1335] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:42.774156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380128-69a3-4fae-ac63-be2118f4cfb4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:42.774607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380128-69a3-4fae-ac63-be2118f4cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:42.774716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54380128-69a3-4fae-ac63-be2118f4cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:42.839743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-54380128-69a3-4fae-ac63-be2118f4cfb4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:42.840929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-54380128-69a3-4fae-ac63-be2118f4cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:42.915572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:42.938338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 680/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:19:42.979400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:42.980920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:43.084498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962d48-ccc3-4a8c-afc5-d1efce4fd932 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:43.113438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:43.158495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:43.159146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:43.159456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:43.159732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:43.161401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:43.270461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:43.271942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37295-7a66-4d62-ad85-4474ad21bcb8 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:43.289702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 657/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:45.857810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:45.858566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:45.858566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:45.859909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 681/1338] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:45.865149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9368bf-1a58-4adc-aefc-75d279d36b86 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:45.865549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9368bf-1a58-4adc-aefc-75d279d36b86 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:45.865711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9368bf-1a58-4adc-aefc-75d279d36b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:45.929527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-be9368bf-1a58-4adc-aefc-75d279d36b86 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:45.930728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-be9368bf-1a58-4adc-aefc-75d279d36b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:45.940227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:46.028235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 658/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:46.064822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:46.066410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:46.169345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef0c5b-3b92-4bbc-aa11-17fda34d0cf6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:46.242782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:46.243463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:46.243747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:46.244021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:46.245640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:46.280960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:46.354184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:46.355633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79dd8-2ee7-4ba5-9b66-c471e9346cb6 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:46.373730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 682/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:50.716707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:50.717222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:50.717350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:50.719742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 659/1341] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:50.725066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11ff9-a90d-4d46-89ea-b91b37649d48 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:50.725493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11ff9-a90d-4d46-89ea-b91b37649d48 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:50.725636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11ff9-a90d-4d46-89ea-b91b37649d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:50.796677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-10c11ff9-a90d-4d46-89ea-b91b37649d48 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:50.797874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-10c11ff9-a90d-4d46-89ea-b91b37649d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:50.892641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:50.907245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 683/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:50.945525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:50.947829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:51.046379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c51e1a-9eeb-44b1-82f1-ee46457afb2f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:51.050017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:51.050668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:51.050951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:51.051226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:51.060354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:51.062391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a650495-b861-4a3b-b600-7ebd31342a1e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:51.071935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 660/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:53.932814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891009a6-5073-461f-b38a-7e54ddad5551 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:53.933370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891009a6-5073-461f-b38a-7e54ddad5551 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:53.933370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891009a6-5073-461f-b38a-7e54ddad5551 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:53.934748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 684/1344] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:53.940578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38ece-9c70-4574-b58b-2af13162a5b3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:53.941004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38ece-9c70-4574-b58b-2af13162a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:53.941297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38ece-9c70-4574-b58b-2af13162a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:53.970322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-38f38ece-9c70-4574-b58b-2af13162a5b3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:53.971557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-38f38ece-9c70-4574-b58b-2af13162a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:53.999862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:19:54.050014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 661/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:54.086105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891009a6-5073-461f-b38a-7e54ddad5551 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:54.097974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891009a6-5073-461f-b38a-7e54ddad5551 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:54.101536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:54.102184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:54.102464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:54.102740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:54.112743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:54.114142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e3f06-7454-4480-8e3f-9b726b234341 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:54.123733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 685/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:19:58.644393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36c01-0fcc-4697-852b-c2d1199e7b3f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:58.644960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36c01-0fcc-4697-852b-c2d1199e7b3f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:58.644960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc36c01-0fcc-4697-852b-c2d1199e7b3f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:58.646332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 662/1347] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:19:58.651696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6095d4-fad4-4b6b-84cb-78cf96737165 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:58.652086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6095d4-fad4-4b6b-84cb-78cf96737165 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:58.652391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6095d4-fad4-4b6b-84cb-78cf96737165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:58.669897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9a6095d4-fad4-4b6b-84cb-78cf96737165 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:19:58.671117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9a6095d4-fad4-4b6b-84cb-78cf96737165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:19:58.678878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 686/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:19:58.717313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36c01-0fcc-4697-852b-c2d1199e7b3f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:19:58.728418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc36c01-0fcc-4697-852b-c2d1199e7b3f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:19:58.731924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:19:58.732555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:19:58.732834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:19:58.733106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:19:58.741849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:19:58.743279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68825181-c9ba-4447-939c-ed6f2977cb65 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:19:58.753092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 663/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:04.140844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87ca3-93a6-4158-a3a2-608ebbf512b9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:04.141776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87ca3-93a6-4158-a3a2-608ebbf512b9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:04.142203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c87ca3-93a6-4158-a3a2-608ebbf512b9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:04.144057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 687/1350] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:04.149124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332251-e0dc-487a-97e7-612bd7bba425 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:04.149549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332251-e0dc-487a-97e7-612bd7bba425 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:04.149809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332251-e0dc-487a-97e7-612bd7bba425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:04.226874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-53332251-e0dc-487a-97e7-612bd7bba425 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:04.228150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53332251-e0dc-487a-97e7-612bd7bba425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:04.318638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 664/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:08.564571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22878-10e8-4208-b203-f550dcb4b5b4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:08.565134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22878-10e8-4208-b203-f550dcb4b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:08.565134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e22878-10e8-4208-b203-f550dcb4b5b4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:08.566674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 688/1352] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:08.573189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6649-e2db-4108-a33e-3ea1e3e7bd51 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:08.574032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6649-e2db-4108-a33e-3ea1e3e7bd51 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:08.574480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa6649-e2db-4108-a33e-3ea1e3e7bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:08.595973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2bfa6649-e2db-4108-a33e-3ea1e3e7bd51 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:08.597391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2bfa6649-e2db-4108-a33e-3ea1e3e7bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:08.610851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 665/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:08.664967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=13 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:10.354097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba196e2-7cf6-4f30-b68b-8fc04e64c948 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:10.354755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba196e2-7cf6-4f30-b68b-8fc04e64c948 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:10.354755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba196e2-7cf6-4f30-b68b-8fc04e64c948 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:10.356103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 689/1354] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:10.362939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913375a3-e0ba-453f-ba76-390cb2c7b8f1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:10.363754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913375a3-e0ba-453f-ba76-390cb2c7b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:10.364180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913375a3-e0ba-453f-ba76-390cb2c7b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:10.383757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-913375a3-e0ba-453f-ba76-390cb2c7b8f1 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:10.384959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-913375a3-e0ba-453f-ba76-390cb2c7b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:10.393655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 666/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:20:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:20:14.231480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d015-6556-438a-9f01-a447a685aefb None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:14.232456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d015-6556-438a-9f01-a447a685aefb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:14.232951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d015-6556-438a-9f01-a447a685aefb None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:14.240729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050605-c780-4eef-b4c1-ff863550c256 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:14.241159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050605-c780-4eef-b4c1-ff863550c256 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:14.241290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050605-c780-4eef-b4c1-ff863550c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:14.243940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 690/1356] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:14.277183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-45050605-c780-4eef-b4c1-ff863550c256 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:14.278619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-45050605-c780-4eef-b4c1-ff863550c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:14.288249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 667/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:14.342363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a77ef-502c-4d6e-b631-078d17b7e9d1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:14.342658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a77ef-502c-4d6e-b631-078d17b7e9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:14.342935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a77ef-502c-4d6e-b631-078d17b7e9d1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:14.345549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 691/1358] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 15:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:14.353833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5d4a8-9416-481d-bb1a-5ac819469dc8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:14.358033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5d4a8-9416-481d-bb1a-5ac819469dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:14.358574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5d4a8-9416-481d-bb1a-5ac819469dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:14.409944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:14.419562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dce5d4a8-9416-481d-bb1a-5ac819469dc8 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:14.420893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dce5d4a8-9416-481d-bb1a-5ac819469dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:14.509135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 668/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:14.517262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a77ef-502c-4d6e-b631-078d17b7e9d1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:14.533259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a77ef-502c-4d6e-b631-078d17b7e9d1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:14.539375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:14.540123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:14.540480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:14.540828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:14.550366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:14.552129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d491ae-8501-4b98-bf7f-19429cc32672 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:14.562037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 692/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:17.049131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1fda-2d72-4f3b-805c-13cfbbda8878 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:17.049771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1fda-2d72-4f3b-805c-13cfbbda8878 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:17.049977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e1fda-2d72-4f3b-805c-13cfbbda8878 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:17.055116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 669/1361] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:17.056999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023b2b-6e61-453f-b5c1-77f0ca79af97 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:17.057444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023b2b-6e61-453f-b5c1-77f0ca79af97 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:17.057740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12023b2b-6e61-453f-b5c1-77f0ca79af97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:17.078901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-12023b2b-6e61-453f-b5c1-77f0ca79af97 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:17.080143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12023b2b-6e61-453f-b5c1-77f0ca79af97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:17.088744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 693/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:20:17.133911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e1fda-2d72-4f3b-805c-13cfbbda8878 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:17.148867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e1fda-2d72-4f3b-805c-13cfbbda8878 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:17.154313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:17.154951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:17.155237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:17.155549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:17.164672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:17.166288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627b5c-e0df-4d16-92c2-fb77c550a0f3 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:17.176504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 670/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:19.774281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec929ef-7d8c-4bbc-a2ea-a5d363de605b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:19.779403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec929ef-7d8c-4bbc-a2ea-a5d363de605b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:19.779867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec929ef-7d8c-4bbc-a2ea-a5d363de605b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:19.783328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 694/1364] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:19.793410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eaa26-e269-450b-b1f3-398f6b66f3fc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:19.794260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eaa26-e269-450b-b1f3-398f6b66f3fc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:19.794688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eaa26-e269-450b-b1f3-398f6b66f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:19.825414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4a6eaa26-e269-450b-b1f3-398f6b66f3fc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:19.826409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4a6eaa26-e269-450b-b1f3-398f6b66f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:19.835220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 671/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:19.883151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421fcf3-53dc-414b-859e-e46868393c79 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:19.883480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421fcf3-53dc-414b-859e-e46868393c79 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:19.883768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421fcf3-53dc-414b-859e-e46868393c79 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:19.885140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 695/1366] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 15:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:19.890503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56d8-2c96-4985-80bd-b0ebff1cda45 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:19.890796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56d8-2c96-4985-80bd-b0ebff1cda45 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:19.891778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c56d8-2c96-4985-80bd-b0ebff1cda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:19.911381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-192c56d8-2c96-4985-80bd-b0ebff1cda45 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:19.912571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-192c56d8-2c96-4985-80bd-b0ebff1cda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:19.921825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 672/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:19.929834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421fcf3-53dc-414b-859e-e46868393c79 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:19.944262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421fcf3-53dc-414b-859e-e46868393c79 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:19.949815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:19.950454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:19.950744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:19.951026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:19.960054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:19.961630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165b588-bae4-4cfc-891a-2387b0418c1c service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:19.972015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 696/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:22.264741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4165-38fb-49b2-ab93-84fc55b62d31 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.265284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4165-38fb-49b2-ab93-84fc55b62d31 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.265578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4165-38fb-49b2-ab93-84fc55b62d31 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.268358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 673/1369] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:22.273229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1b6-0833-44a9-9385-c735884a4eb0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.273677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1b6-0833-44a9-9385-c735884a4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.273787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150e1b6-0833-44a9-9385-c735884a4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.292039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3150e1b6-0833-44a9-9385-c735884a4eb0 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:22.293467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3150e1b6-0833-44a9-9385-c735884a4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:22.302482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 697/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:22.348798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4165-38fb-49b2-ab93-84fc55b62d31 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:22.365857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4165-38fb-49b2-ab93-84fc55b62d31 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:22.372189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:22.372837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.373130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.373391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.383477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:22.385075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012b4e9-366e-4d70-b77b-058aa1094593 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:22.395325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 674/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:22.513219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c87c8c-dbbb-4894-a73d-0aaa5274761a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.513511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c87c8c-dbbb-4894-a73d-0aaa5274761a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.513986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c87c8c-dbbb-4894-a73d-0aaa5274761a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.515799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 698/1372] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:22.521808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156875-515c-4f15-b678-3003263516b2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.522105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156875-515c-4f15-b678-3003263516b2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.522590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156875-515c-4f15-b678-3003263516b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.544385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-60156875-515c-4f15-b678-3003263516b2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:22.546024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-60156875-515c-4f15-b678-3003263516b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:22.562840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 675/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:22.878585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211425-d918-42eb-b41f-27bcc5c6ac24 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.879008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211425-d918-42eb-b41f-27bcc5c6ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.879469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11211425-d918-42eb-b41f-27bcc5c6ac24 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.881038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 699/1374] 10.222.0.46 () {54 vars in 963 bytes} [Mon May 23 15:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:22.887262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e517-120b-4304-b3a5-bca79b69959e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:22.887691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e517-120b-4304-b3a5-bca79b69959e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:22.888074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841e517-120b-4304-b3a5-bca79b69959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:22.941482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0841e517-120b-4304-b3a5-bca79b69959e None None] MFA Rules not processed for user `ee8345ccaca544058ac7df6888e6ab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:22.942864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0841e517-120b-4304-b3a5-bca79b69959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:23.008081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 676/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Mon May 23 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:23.015744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211425-d918-42eb-b41f-27bcc5c6ac24 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:23.026937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11211425-d918-42eb-b41f-27bcc5c6ac24 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:23.030661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73322-d358-4760-8099-b271d290849a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:23.031467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73322-d358-4760-8099-b271d290849a service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:23.032023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73322-d358-4760-8099-b271d290849a service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:23.032407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73322-d358-4760-8099-b271d290849a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:23.044501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73322-d358-4760-8099-b271d290849a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:23.046061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73322-d358-4760-8099-b271d290849a service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:23.056777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 700/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:24.681135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5241-a97c-4a0c-8642-8c649ec2db18 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:24.681704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5241-a97c-4a0c-8642-8c649ec2db18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:24.681704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5241-a97c-4a0c-8642-8c649ec2db18 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:24.683047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 677/1377] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:24.689827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab886-3e6d-4eed-a8a1-42894e5d86aa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:24.690367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab886-3e6d-4eed-a8a1-42894e5d86aa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:24.690548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab886-3e6d-4eed-a8a1-42894e5d86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:24.716677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-477ab886-3e6d-4eed-a8a1-42894e5d86aa None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:24.717943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-477ab886-3e6d-4eed-a8a1-42894e5d86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:24.726861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 701/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:24.772816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de5241-a97c-4a0c-8642-8c649ec2db18 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:24.788511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de5241-a97c-4a0c-8642-8c649ec2db18 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:24.794310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:24.794988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:24.795276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:24.795591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:24.805275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:24.806951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66748-409a-400d-8daf-0812091b9d4c service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:24.811464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:24.820063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 678/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:27.116236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8a8-23b4-4fd1-b0a8-7eefbbc15cb2 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:27.116784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8a8-23b4-4fd1-b0a8-7eefbbc15cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:27.116784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacc8a8-23b4-4fd1-b0a8-7eefbbc15cb2 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:27.118161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 702/1380] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:27.123563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20ec-d8bf-4ad5-aad0-54f16d9000d3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:27.123978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20ec-d8bf-4ad5-aad0-54f16d9000d3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:27.124107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf20ec-d8bf-4ad5-aad0-54f16d9000d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:27.144032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0abf20ec-d8bf-4ad5-aad0-54f16d9000d3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:27.145223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0abf20ec-d8bf-4ad5-aad0-54f16d9000d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:27.153248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 679/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:27.198036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc8a8-23b4-4fd1-b0a8-7eefbbc15cb2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:27.214080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacc8a8-23b4-4fd1-b0a8-7eefbbc15cb2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:27.224434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:27.225228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:27.225612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:27.226008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:27.235108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:27.236862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca3813-23a5-487f-840c-5541ddce3d5d service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:27.246908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 703/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:29.526333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5b4aa-c745-4335-a3ad-1c5bbfef1389 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:29.526911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5b4aa-c745-4335-a3ad-1c5bbfef1389 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:29.526911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5b4aa-c745-4335-a3ad-1c5bbfef1389 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:29.528436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 680/1383] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:29.534986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b919f2-07b8-4d0e-a1f2-e7ec9433cb10 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:29.535581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b919f2-07b8-4d0e-a1f2-e7ec9433cb10 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:29.535581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b919f2-07b8-4d0e-a1f2-e7ec9433cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:29.556432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-96b919f2-07b8-4d0e-a1f2-e7ec9433cb10 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:29.557880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-96b919f2-07b8-4d0e-a1f2-e7ec9433cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:29.568469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 704/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:29.611156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5b4aa-c745-4335-a3ad-1c5bbfef1389 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:29.628405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5b4aa-c745-4335-a3ad-1c5bbfef1389 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:29.634986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:29.635811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:29.636100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:29.636382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:29.646114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:29.647779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07d04-6a57-4f3d-9654-bd694a4d2c37 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:29.660123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 681/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:31.913735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe455d-8928-495b-9b5c-1176b94905a0 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:31.914270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe455d-8928-495b-9b5c-1176b94905a0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:31.914819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe455d-8928-495b-9b5c-1176b94905a0 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:31.916759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 705/1386] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:31.923381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063f67-d38e-40b0-9bac-5a22a0b6b9f7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:31.923828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063f67-d38e-40b0-9bac-5a22a0b6b9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:31.923985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063f67-d38e-40b0-9bac-5a22a0b6b9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:31.942285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-11063f67-d38e-40b0-9bac-5a22a0b6b9f7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:31.943535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-11063f67-d38e-40b0-9bac-5a22a0b6b9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:31.951726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 682/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:31.997201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe455d-8928-495b-9b5c-1176b94905a0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:32.013224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe455d-8928-495b-9b5c-1176b94905a0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:32.019349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:32.020035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:32.020325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:32.020607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:32.029076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:32.030667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcd421-eb99-40cf-813a-e5df1e8101b6 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:32.040264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 706/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:34.273327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45751-491e-451d-878f-12eba5db3571 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:34.273872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45751-491e-451d-878f-12eba5db3571 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:34.274367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec45751-491e-451d-878f-12eba5db3571 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:34.276329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 683/1389] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:34.281868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60cd6-c2bf-4d8d-94ae-712cc5a62f0c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:34.283408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60cd6-c2bf-4d8d-94ae-712cc5a62f0c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:34.283408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60cd6-c2bf-4d8d-94ae-712cc5a62f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:34.302262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-69f60cd6-c2bf-4d8d-94ae-712cc5a62f0c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:34.303567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-69f60cd6-c2bf-4d8d-94ae-712cc5a62f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:34.311831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 707/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:34.358677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec45751-491e-451d-878f-12eba5db3571 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:34.378183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec45751-491e-451d-878f-12eba5db3571 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:34.385174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:34.385958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:34.386382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:34.386733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:34.397879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:34.399969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39003bc8-07ca-40e5-9056-70e3fdfd9dfc service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:34.413434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 684/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:20:36.743531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40e05-e919-468c-818b-4a54b1803c69 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:36.744201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40e05-e919-468c-818b-4a54b1803c69 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:36.744201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef40e05-e919-468c-818b-4a54b1803c69 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:36.745466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 708/1392] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:36.751004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a943-77c8-4d6b-a817-9fb60966ffe1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:36.751582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a943-77c8-4d6b-a817-9fb60966ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:36.751901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051a943-77c8-4d6b-a817-9fb60966ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:36.769863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d051a943-77c8-4d6b-a817-9fb60966ffe1 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:36.771084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d051a943-77c8-4d6b-a817-9fb60966ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:36.778953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 685/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:36.823752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef40e05-e919-468c-818b-4a54b1803c69 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:36.838565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef40e05-e919-468c-818b-4a54b1803c69 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:36.844466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:36.845693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:36.845968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:36.846425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:36.855645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:36.857225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b65275-1338-4362-a95c-307b6cc2c53b service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:36.867660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 709/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:38.819317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951d85-053a-4663-b566-ec1fc6cb1475 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:38.820233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951d85-053a-4663-b566-ec1fc6cb1475 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:38.820685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04951d85-053a-4663-b566-ec1fc6cb1475 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:38.822230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 686/1395] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:38.827736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3095cb-f914-47af-952d-c3b1fe0dfe8f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:38.828190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3095cb-f914-47af-952d-c3b1fe0dfe8f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:38.828289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3095cb-f914-47af-952d-c3b1fe0dfe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:38.834505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=52 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:38.848367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ee3095cb-f914-47af-952d-c3b1fe0dfe8f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:38.849558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ee3095cb-f914-47af-952d-c3b1fe0dfe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:38.857344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 710/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:38.912706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109576f-c38c-4313-9881-eff332396a18 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:38.913003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109576f-c38c-4313-9881-eff332396a18 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:38.913285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109576f-c38c-4313-9881-eff332396a18 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:38.914674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 687/1397] 10.222.0.46 () {54 vars in 962 bytes} [Mon May 23 15:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:38.919792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993b3a-e788-4cc3-b18a-773019c292e2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:38.920118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993b3a-e788-4cc3-b18a-773019c292e2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:38.920405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993b3a-e788-4cc3-b18a-773019c292e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:38.969760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f2993b3a-e788-4cc3-b18a-773019c292e2 None None] MFA Rules not processed for user `544901ebce6e483cae9a9e03b3eac3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:38.971670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f2993b3a-e788-4cc3-b18a-773019c292e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:39.038316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 711/1398] 10.222.0.46 () {58 vars in 1059 bytes} [Mon May 23 15:20:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:39.046444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109576f-c38c-4313-9881-eff332396a18 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:39.057728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109576f-c38c-4313-9881-eff332396a18 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:39.061243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:39.061884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.062167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.062441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.072347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:39.073722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdfa2c-768c-4faa-a214-7e08438beba7 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:39.083807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 688/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:39.205176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0eaa1-7b26-4fd9-a5bc-b449d787cea7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.205475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0eaa1-7b26-4fd9-a5bc-b449d787cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.205765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0eaa1-7b26-4fd9-a5bc-b449d787cea7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.207187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 712/1400] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:20:39.212467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354da9-3ba3-4ee3-ae8e-36f39970d524 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.212831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354da9-3ba3-4ee3-ae8e-36f39970d524 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.213181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354da9-3ba3-4ee3-ae8e-36f39970d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.232219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b9354da9-3ba3-4ee3-ae8e-36f39970d524 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:39.233440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b9354da9-3ba3-4ee3-ae8e-36f39970d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:39.242038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 689/1401] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:39.287929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0eaa1-7b26-4fd9-a5bc-b449d787cea7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:39.302891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0eaa1-7b26-4fd9-a5bc-b449d787cea7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:39.308336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dde56-404d-4212-9198-62a194e29794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:39.308982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde56-404d-4212-9198-62a194e29794 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.309267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde56-404d-4212-9198-62a194e29794 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.309546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde56-404d-4212-9198-62a194e29794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.318801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dde56-404d-4212-9198-62a194e29794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:39.320577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dde56-404d-4212-9198-62a194e29794 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:39.332090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 713/1402] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:39.645899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f74ea-9df1-4158-96c9-b1c866dd5cc8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.646265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f74ea-9df1-4158-96c9-b1c866dd5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.646613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f74ea-9df1-4158-96c9-b1c866dd5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.698681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-928f74ea-9df1-4158-96c9-b1c866dd5cc8 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:39.700009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-928f74ea-9df1-4158-96c9-b1c866dd5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:39.769290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 690/1403] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:39.812873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57cdfb-f48c-4aa3-b652-19cc2071b7a4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.813170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57cdfb-f48c-4aa3-b652-19cc2071b7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.813457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57cdfb-f48c-4aa3-b652-19cc2071b7a4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.815565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 714/1404] 10.222.0.46 () {54 vars in 942 bytes} [Mon May 23 15:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:39.822119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65617d-65e3-4506-96af-080a3f5db9fd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:39.822616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65617d-65e3-4506-96af-080a3f5db9fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:39.822831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65617d-65e3-4506-96af-080a3f5db9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:39.892945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2c65617d-65e3-4506-96af-080a3f5db9fd None None] MFA Rules not processed for user `7457fcf08cac43a3831a145946f12bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:39.894397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2c65617d-65e3-4506-96af-080a3f5db9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:39.930327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:39.973392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 691/1405] 10.222.0.46 () {58 vars in 1039 bytes} [Mon May 23 15:20:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:39.982624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57cdfb-f48c-4aa3-b652-19cc2071b7a4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:39.996287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57cdfb-f48c-4aa3-b652-19cc2071b7a4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:40.001251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:40.002474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:40.002756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:40.003036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:40.011215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:40.012854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b1b50-75cd-4f54-ad33-88d419ef75c8 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:40.021601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 715/1406] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:20:41.688327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59637677-5cc1-4307-9ab4-196d1d224a7f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:41.688897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59637677-5cc1-4307-9ab4-196d1d224a7f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:41.688897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59637677-5cc1-4307-9ab4-196d1d224a7f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:41.691199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 692/1407] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:20:41.696851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39a68-9bcf-4311-8db2-4491d222d844 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:41.697268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39a68-9bcf-4311-8db2-4491d222d844 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:41.697435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39a68-9bcf-4311-8db2-4491d222d844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:41.717024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9fc39a68-9bcf-4311-8db2-4491d222d844 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:20:41.718364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9fc39a68-9bcf-4311-8db2-4491d222d844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:20:41.729369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 716/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:20:41.776822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59637677-5cc1-4307-9ab4-196d1d224a7f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:20:41.792618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59637677-5cc1-4307-9ab4-196d1d224a7f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:20:41.798780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:20:41.799748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:20:41.800119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:20:41.800494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:20:41.813357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:20:41.815570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bbf90-97ed-42d6-b86c-1baa9afc82b3 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:20:41.826119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 693/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:20:51.731870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=55 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:20:51.832940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=21 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:03.194064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef6d53-2ef3-4d5a-9f26-22e5d56c4a2b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:03.194665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef6d53-2ef3-4d5a-9f26-22e5d56c4a2b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:03.194665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef6d53-2ef3-4d5a-9f26-22e5d56c4a2b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:03.195946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 717/1410] 10.222.0.46 () {54 vars in 918 bytes} [Mon May 23 15:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:03.200887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fbe7-ecdb-4fcf-805b-0c0fd9952499 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:03.201367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fbe7-ecdb-4fcf-805b-0c0fd9952499 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:03.201477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492fbe7-ecdb-4fcf-805b-0c0fd9952499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:03.219192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c492fbe7-ecdb-4fcf-805b-0c0fd9952499 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:03.220415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c492fbe7-ecdb-4fcf-805b-0c0fd9952499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:03.230032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 694/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Mon May 23 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:03.244646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374ad4-0795-4698-be14-c1016532f97e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:03.244933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374ad4-0795-4698-be14-c1016532f97e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:03.245211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c374ad4-0795-4698-be14-c1016532f97e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:03.246558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 718/1412] 10.222.0.46 () {54 vars in 918 bytes} [Mon May 23 15:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:03.251237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69007-68db-441a-806e-81a122a7e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:03.251564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69007-68db-441a-806e-81a122a7e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:03.251848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c69007-68db-441a-806e-81a122a7e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:03.269358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c2c69007-68db-441a-806e-81a122a7e9b8 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:03.270530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c2c69007-68db-441a-806e-81a122a7e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:03.279607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 695/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Mon May 23 15:21:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:21:05.948741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e63be-e089-4f9e-97f6-7220582736ad None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:05.949271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e63be-e089-4f9e-97f6-7220582736ad None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:05.949271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e63be-e089-4f9e-97f6-7220582736ad None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:05.950652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:05.955855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ad76-f85f-4f26-8c2c-1998ad0485e8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:05.956376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ad76-f85f-4f26-8c2c-1998ad0485e8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:05.956550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714ad76-f85f-4f26-8c2c-1998ad0485e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:05.975036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5714ad76-f85f-4f26-8c2c-1998ad0485e8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:05.976344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5714ad76-f85f-4f26-8c2c-1998ad0485e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:05.984277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:06.026882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e63be-e089-4f9e-97f6-7220582736ad None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:06.042107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e63be-e089-4f9e-97f6-7220582736ad None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:06.047448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:06.048067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:06.048347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:06.048620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:06.057487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:06.059055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9f636-a1c1-4143-bbd8-61f661385535 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:06.068516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 720/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:07.096455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6009b-68d3-42ae-be38-0a0f1a37019a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:07.097932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6009b-68d3-42ae-be38-0a0f1a37019a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:07.097932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6009b-68d3-42ae-be38-0a0f1a37019a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:07.099318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:07.104824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18cea5-4327-4ca1-94be-255270c53565 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:07.105244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18cea5-4327-4ca1-94be-255270c53565 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:07.105379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18cea5-4327-4ca1-94be-255270c53565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:07.123656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ad18cea5-4327-4ca1-94be-255270c53565 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:07.124877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ad18cea5-4327-4ca1-94be-255270c53565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:07.132701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:07.305225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6009b-68d3-42ae-be38-0a0f1a37019a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:07.319705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6009b-68d3-42ae-be38-0a0f1a37019a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:07.327392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:07.328517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:07.329036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:07.329544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:07.342991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:07.346149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb5e5d-5c1d-47f3-b8e9-695cafe621af service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:07.364571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 698/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:08.287928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0818cd-e905-48e0-8cdb-287be2348ba6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:08.288490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0818cd-e905-48e0-8cdb-287be2348ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:08.288490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0818cd-e905-48e0-8cdb-287be2348ba6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:08.289868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:08.294801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ceb1-72c0-4a00-9ec8-7c44caeac5d5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:08.295246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ceb1-72c0-4a00-9ec8-7c44caeac5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:08.295523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325ceb1-72c0-4a00-9ec8-7c44caeac5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:08.314151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2325ceb1-72c0-4a00-9ec8-7c44caeac5d5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:08.315352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2325ceb1-72c0-4a00-9ec8-7c44caeac5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:08.323985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:08.472413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0818cd-e905-48e0-8cdb-287be2348ba6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:08.486824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0818cd-e905-48e0-8cdb-287be2348ba6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:08.492471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:08.493104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:08.493392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:08.493665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:08.501654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:08.503870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c33b2-554a-48a2-ae10-f2a4f0eb0751 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:08.513291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 723/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:09.463509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23db6-6d41-4386-992c-97b025b3a274 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:09.464039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23db6-6d41-4386-992c-97b025b3a274 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:09.464039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23db6-6d41-4386-992c-97b025b3a274 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:09.465517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:09.470535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133cef-fc0a-497b-adfd-7361cd24289f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:09.470955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133cef-fc0a-497b-adfd-7361cd24289f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:09.471094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133cef-fc0a-497b-adfd-7361cd24289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:09.489933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-54133cef-fc0a-497b-adfd-7361cd24289f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:09.491109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-54133cef-fc0a-497b-adfd-7361cd24289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:09.498853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:09.648191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d23db6-6d41-4386-992c-97b025b3a274 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:09.662514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d23db6-6d41-4386-992c-97b025b3a274 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:09.667926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:09.668562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:09.668846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:09.669124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:09.678131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:09.679788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e129cac-3859-4703-9fc9-ed1d0245bc7f service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:09.689156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 701/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:10.594257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f2f3-e4e3-4cdf-9f53-ec12033966fb None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:10.594826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f2f3-e4e3-4cdf-9f53-ec12033966fb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:10.594826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f2f3-e4e3-4cdf-9f53-ec12033966fb None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:10.596244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:10.602283 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff517f2-6296-4401-9a7f-105010e817a8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:10.602714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff517f2-6296-4401-9a7f-105010e817a8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:10.602829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff517f2-6296-4401-9a7f-105010e817a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:10.622910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4ff517f2-6296-4401-9a7f-105010e817a8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:10.624143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4ff517f2-6296-4401-9a7f-105010e817a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:10.632555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:10.780863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f2f3-e4e3-4cdf-9f53-ec12033966fb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:10.796858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f2f3-e4e3-4cdf-9f53-ec12033966fb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:10.803077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:10.803757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:10.804046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:10.804332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:10.813115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:10.814702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a08408-8f80-4d1c-9fd6-dbf4609ce643 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:10.825115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 726/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:11.672731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe432-3b57-43e7-917e-04a083b4ba07 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:11.673244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe432-3b57-43e7-917e-04a083b4ba07 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:11.673244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe432-3b57-43e7-917e-04a083b4ba07 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:11.674647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:11.680409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab49a5-fc35-4667-aa47-2c516a62ba90 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:11.680822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab49a5-fc35-4667-aa47-2c516a62ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:11.680967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab49a5-fc35-4667-aa47-2c516a62ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:11.699273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-22ab49a5-fc35-4667-aa47-2c516a62ba90 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:11.700504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-22ab49a5-fc35-4667-aa47-2c516a62ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:11.708576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:11.859486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe432-3b57-43e7-917e-04a083b4ba07 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:11.874444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe432-3b57-43e7-917e-04a083b4ba07 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:11.880711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:11.881347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:11.881625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:11.881899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:11.890077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:11.891702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840bc8d-e287-4087-a631-49261e63e973 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:11.901107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 704/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:12.751248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c890c-e002-4385-918b-e412bb22dd5e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:12.751827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c890c-e002-4385-918b-e412bb22dd5e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:12.751827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c890c-e002-4385-918b-e412bb22dd5e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:12.753738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:12.758901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f7f-e0f1-442f-8b98-0aaf8d4a5d7b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:12.759337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f7f-e0f1-442f-8b98-0aaf8d4a5d7b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:12.759503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f1f7f-e0f1-442f-8b98-0aaf8d4a5d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:12.777799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a74f1f7f-e0f1-442f-8b98-0aaf8d4a5d7b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:12.778988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a74f1f7f-e0f1-442f-8b98-0aaf8d4a5d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:12.786918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:12.935758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c890c-e002-4385-918b-e412bb22dd5e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:12.950699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c890c-e002-4385-918b-e412bb22dd5e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:12.956066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:12.957662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:12.957949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:12.958228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:12.966260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:12.967877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169ff0d-1425-42fc-b10f-a12fb8cfd81b service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:12.978463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 729/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:13.834232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac7c0-c3a3-4740-b1d2-6c818e258481 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:13.834709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac7c0-c3a3-4740-b1d2-6c818e258481 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:13.834821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ac7c0-c3a3-4740-b1d2-6c818e258481 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:13.836215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:13.841141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c19e-765f-4866-a00b-c1e406b006e6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:13.841569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c19e-765f-4866-a00b-c1e406b006e6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:13.841695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0c19e-765f-4866-a00b-c1e406b006e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:13.859552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-25a0c19e-765f-4866-a00b-c1e406b006e6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:13.860737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-25a0c19e-765f-4866-a00b-c1e406b006e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:13.869024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:14.026647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ac7c0-c3a3-4740-b1d2-6c818e258481 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:14.041245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ac7c0-c3a3-4740-b1d2-6c818e258481 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:14.046640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:14.047277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:14.047595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:14.047874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:14.057075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:14.058657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f79c3-a0a6-401b-8631-937a83a09d4d service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:14.068824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 707/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:14.915377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee339b-f1d1-449c-8aad-dd8fbcc21a15 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:14.915919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee339b-f1d1-449c-8aad-dd8fbcc21a15 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:14.915919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee339b-f1d1-449c-8aad-dd8fbcc21a15 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:14.917325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:14.922336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e722-3dec-4ccc-a91d-6faed451e4c1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:14.922743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e722-3dec-4ccc-a91d-6faed451e4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:14.922893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0e722-3dec-4ccc-a91d-6faed451e4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:14.942190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-12c0e722-3dec-4ccc-a91d-6faed451e4c1 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:14.943427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-12c0e722-3dec-4ccc-a91d-6faed451e4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:14.951226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:15.119076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee339b-f1d1-449c-8aad-dd8fbcc21a15 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:15.134143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee339b-f1d1-449c-8aad-dd8fbcc21a15 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:15.139562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:15.140202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:15.140485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:15.140760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:15.149868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:15.151459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09329c-c3e1-4800-9f61-368306690db7 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:15.160693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 732/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:17.281738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7647f-2009-458b-b4b3-4cdbc81fb7fd None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:17.282320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7647f-2009-458b-b4b3-4cdbc81fb7fd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:17.282320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7647f-2009-458b-b4b3-4cdbc81fb7fd None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:17.283738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:17.289193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe307-dd1a-4491-b3e7-bb0a37ead58f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:17.289603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe307-dd1a-4491-b3e7-bb0a37ead58f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:17.289755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fe307-dd1a-4491-b3e7-bb0a37ead58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:17.307758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-737fe307-dd1a-4491-b3e7-bb0a37ead58f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:17.308954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-737fe307-dd1a-4491-b3e7-bb0a37ead58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:17.317249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:17.355761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7647f-2009-458b-b4b3-4cdbc81fb7fd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:17.366476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7647f-2009-458b-b4b3-4cdbc81fb7fd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:17.369997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:17.370636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:17.370922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:17.371199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:17.380760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:17.382202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6f562-b2c0-412d-849e-3f95717cb88b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:17.391602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 710/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:19.767803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca95e-810a-4098-8535-31d3963db042 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:19.768353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca95e-810a-4098-8535-31d3963db042 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:19.768353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca95e-810a-4098-8535-31d3963db042 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:19.770092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:19.775571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca09d7-b465-4e9b-affd-7e3c7ac6ce6e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:19.776029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca09d7-b465-4e9b-affd-7e3c7ac6ce6e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:19.776253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca09d7-b465-4e9b-affd-7e3c7ac6ce6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:19.795307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c7ca09d7-b465-4e9b-affd-7e3c7ac6ce6e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:19.796510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c7ca09d7-b465-4e9b-affd-7e3c7ac6ce6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:19.805121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:19.844113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ca95e-810a-4098-8535-31d3963db042 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:19.845827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-179ca95e-810a-4098-8535-31d3963db042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:19.859500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ca95e-810a-4098-8535-31d3963db042 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:19.863020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:19.863707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:19.863994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:19.864272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:19.873104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:19.874526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c2d5-b4f6-4bb8-b86c-d00d18bac309 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:19.883877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 735/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:22.386133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9485546-fa93-4f16-8889-499ff44dd929 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:22.386687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9485546-fa93-4f16-8889-499ff44dd929 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:22.386687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9485546-fa93-4f16-8889-499ff44dd929 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:22.388156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:22.393649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ce14-8eb9-42f4-8aa2-b14ff9e9bde0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:22.394112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ce14-8eb9-42f4-8aa2-b14ff9e9bde0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:22.394204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ce14-8eb9-42f4-8aa2-b14ff9e9bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:22.414306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a972ce14-8eb9-42f4-8aa2-b14ff9e9bde0 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:22.415536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a972ce14-8eb9-42f4-8aa2-b14ff9e9bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:22.423304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:22.461846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9485546-fa93-4f16-8889-499ff44dd929 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:22.473171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9485546-fa93-4f16-8889-499ff44dd929 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:22.477052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:22.477683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:22.477962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:22.478231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:22.486986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:22.489078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4aad3-c137-422c-a8ee-b8cad1ed786a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:22.498411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 713/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:24.824509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a390c-445a-417c-86b2-0e59a009a7da None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:24.825125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a390c-445a-417c-86b2-0e59a009a7da None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:24.825125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a390c-445a-417c-86b2-0e59a009a7da None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:24.826458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:24.831892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f456b-f12f-4c14-be08-f7c95e564adc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:24.832323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f456b-f12f-4c14-be08-f7c95e564adc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:24.832470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f456b-f12f-4c14-be08-f7c95e564adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:24.850692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-516f456b-f12f-4c14-be08-f7c95e564adc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:24.852178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-516f456b-f12f-4c14-be08-f7c95e564adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:24.860113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:24.898498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a390c-445a-417c-86b2-0e59a009a7da None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:24.909197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a390c-445a-417c-86b2-0e59a009a7da None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:24.913203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:24.913836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:24.914117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:24.914390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:24.923157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:24.924606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b104a-ff8a-4104-b823-c6d41c5317e9 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:24.934782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 738/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:27.201707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff60e-4d62-4d02-8466-2421933f46eb None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:27.202231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff60e-4d62-4d02-8466-2421933f46eb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:27.202231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ff60e-4d62-4d02-8466-2421933f46eb None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:27.203630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:27.209726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4489-0a2d-4fb9-bc27-a9ac4c1abe90 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:27.210190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4489-0a2d-4fb9-bc27-a9ac4c1abe90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:27.210299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4489-0a2d-4fb9-bc27-a9ac4c1abe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:27.228094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d7ee4489-0a2d-4fb9-bc27-a9ac4c1abe90 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:27.229304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d7ee4489-0a2d-4fb9-bc27-a9ac4c1abe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:27.237325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:21:27.275179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff60e-4d62-4d02-8466-2421933f46eb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:27.286028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ff60e-4d62-4d02-8466-2421933f46eb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:27.289576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:27.290209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:27.290492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:27.290769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:27.299629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:27.301617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8911c-3913-4662-8269-b2199aade107 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:27.311213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 716/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:29.563426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a538ff-2c8c-4ab3-ab84-2a7396e36e22 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:29.563952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a538ff-2c8c-4ab3-ab84-2a7396e36e22 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:29.563952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a538ff-2c8c-4ab3-ab84-2a7396e36e22 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:29.565311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:29.571454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bce6-6fec-488b-a9d4-b44b786f8d35 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:29.571875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bce6-6fec-488b-a9d4-b44b786f8d35 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:29.572009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782bce6-6fec-488b-a9d4-b44b786f8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:29.589411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4782bce6-6fec-488b-a9d4-b44b786f8d35 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:29.590601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4782bce6-6fec-488b-a9d4-b44b786f8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:29.598656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:29.636758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a538ff-2c8c-4ab3-ab84-2a7396e36e22 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:29.647673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a538ff-2c8c-4ab3-ab84-2a7396e36e22 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:29.651217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:29.651895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:29.652183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:29.652462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:29.661925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:29.663352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a5b8c-7ec8-4bf8-9838-9246d93da5b2 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:29.672747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 741/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:31.989453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3169096-7f26-4512-9111-3c83fa08fba1 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:31.990013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3169096-7f26-4512-9111-3c83fa08fba1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:31.990013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3169096-7f26-4512-9111-3c83fa08fba1 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:31.991425 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:31.996762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a5f8-b354-498d-823c-5fd2d79b4321 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:31.997218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a5f8-b354-498d-823c-5fd2d79b4321 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:31.997323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7a5f8-b354-498d-823c-5fd2d79b4321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:32.003445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=70 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:32.015964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-64f7a5f8-b354-498d-823c-5fd2d79b4321 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:32.017155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-64f7a5f8-b354-498d-823c-5fd2d79b4321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:32.025451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:32.062332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3169096-7f26-4512-9111-3c83fa08fba1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:32.067639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=73 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:32.073808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3169096-7f26-4512-9111-3c83fa08fba1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:32.077543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:32.078133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:32.078420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:32.078698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:32.088166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:32.089611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c91d40-b88f-443e-b015-565dc4925fc9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:32.099773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 719/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:34.343674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2021e-2175-4f4e-b924-777f8dd05d14 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:34.344239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2021e-2175-4f4e-b924-777f8dd05d14 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:34.344239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2021e-2175-4f4e-b924-777f8dd05d14 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:34.345608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:34.351782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809977-b3e9-4d8e-91d4-a59cb5fe2fbd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:34.352484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809977-b3e9-4d8e-91d4-a59cb5fe2fbd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:34.352606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809977-b3e9-4d8e-91d4-a59cb5fe2fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:34.370000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fe809977-b3e9-4d8e-91d4-a59cb5fe2fbd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:34.371192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fe809977-b3e9-4d8e-91d4-a59cb5fe2fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:34.378978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:34.416070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2021e-2175-4f4e-b924-777f8dd05d14 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:34.426890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2021e-2175-4f4e-b924-777f8dd05d14 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:34.430477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:34.431119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:34.431436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:34.431719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:34.440508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:34.442444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f71af-79d0-4a80-9b29-38a2c36fc679 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:34.451791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 744/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:36.635848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba626-435c-4199-954c-0ce152b110ef None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:36.636384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba626-435c-4199-954c-0ce152b110ef None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:36.636384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ba626-435c-4199-954c-0ce152b110ef None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:36.637772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:36.643026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede12f-6c27-4a0e-b77e-243b8761e536 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:36.643480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede12f-6c27-4a0e-b77e-243b8761e536 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:36.643613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ede12f-6c27-4a0e-b77e-243b8761e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:36.661489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-27ede12f-6c27-4a0e-b77e-243b8761e536 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:36.662692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-27ede12f-6c27-4a0e-b77e-243b8761e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:36.670425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:36.707504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ba626-435c-4199-954c-0ce152b110ef None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:36.718456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ba626-435c-4199-954c-0ce152b110ef None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:36.721966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:36.722599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:36.722942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:36.723248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:36.733216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:36.734644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35f3a0-786b-4b92-abe6-f94c9c40274a service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:36.744751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 722/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:38.954403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae1a2-b23f-4b79-a6d1-093e3808c839 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:38.954931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae1a2-b23f-4b79-a6d1-093e3808c839 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:38.955042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae1a2-b23f-4b79-a6d1-093e3808c839 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:38.956455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:21:38.962487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959840-56a2-41ea-af85-9ea765ebc96c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:38.962923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959840-56a2-41ea-af85-9ea765ebc96c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:38.963030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6959840-56a2-41ea-af85-9ea765ebc96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:38.980824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a6959840-56a2-41ea-af85-9ea765ebc96c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:21:38.982017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6959840-56a2-41ea-af85-9ea765ebc96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:21:38.989915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:21:39.026487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae1a2-b23f-4b79-a6d1-093e3808c839 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:21:39.037652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae1a2-b23f-4b79-a6d1-093e3808c839 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:21:39.041224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:21:39.041856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:21:39.042137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:21:39.042408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:21:39.051078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:21:39.052761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792187-b5e4-4449-ae3e-eed570eab61e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:21:39.061905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 747/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:21:48.975487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=17 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:21:49.057873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=17 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:12.196373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cb22-caf8-4321-8ef3-5747e96a22d8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.196968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cb22-caf8-4321-8ef3-5747e96a22d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.196968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70cb22-caf8-4321-8ef3-5747e96a22d8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.198325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 724/1471] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:12.203430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5049-bfc9-4c31-82d5-b9da63812a90 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.203881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5049-bfc9-4c31-82d5-b9da63812a90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.203994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d5049-bfc9-4c31-82d5-b9da63812a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.222633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e81d5049-bfc9-4c31-82d5-b9da63812a90 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:12.223987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e81d5049-bfc9-4c31-82d5-b9da63812a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:12.232750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 748/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:12.279467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c933-b5a1-4d60-b99a-62fe80b235f4 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.279764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c933-b5a1-4d60-b99a-62fe80b235f4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.280040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5c933-b5a1-4d60-b99a-62fe80b235f4 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.281459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 725/1473] 10.222.0.46 () {54 vars in 962 bytes} [Mon May 23 15:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:12.286172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bad9-7d24-45c3-8d3f-7e6986c8f3a4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.286489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bad9-7d24-45c3-8d3f-7e6986c8f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.286776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54bad9-7d24-45c3-8d3f-7e6986c8f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.305154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ca54bad9-7d24-45c3-8d3f-7e6986c8f3a4 None None] MFA Rules not processed for user `544901ebce6e483cae9a9e03b3eac3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:12.306402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ca54bad9-7d24-45c3-8d3f-7e6986c8f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:12.312977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 749/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Mon May 23 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:12.320897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c933-b5a1-4d60-b99a-62fe80b235f4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:12.331649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5c933-b5a1-4d60-b99a-62fe80b235f4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:12.335136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:12.335789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:12.336065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:12.336336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:12.345105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:12.346580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600ca56-bc2f-4df8-8f1c-b9e91d3e908f service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:12.356423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 726/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:22:14.646057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1d4c-cded-47fe-a768-a761cb661e61 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.646590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1d4c-cded-47fe-a768-a761cb661e61 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.646590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d1d4c-cded-47fe-a768-a761cb661e61 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.648528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 750/1476] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:14.654138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412071-2e3b-4604-9e09-882cc6b36403 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.654545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412071-2e3b-4604-9e09-882cc6b36403 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.654697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412071-2e3b-4604-9e09-882cc6b36403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.673004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2a412071-2e3b-4604-9e09-882cc6b36403 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:14.674234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2a412071-2e3b-4604-9e09-882cc6b36403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:14.682189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 727/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:14.704805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d1d4c-cded-47fe-a768-a761cb661e61 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:14.717759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d1d4c-cded-47fe-a768-a761cb661e61 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:14.722224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:14.722878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:14.723164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:14.723466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:14.724198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:14.726591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:22:14.726591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:22:14.726591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:22:14.727787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9ec06-f889-42bb-a7e2-262e6e409216 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:14.747744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 751/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Mon May 23 15:22:14 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:22:16.979009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06903-931f-4d13-94a1-f0c3fde8944e None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.979611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06903-931f-4d13-94a1-f0c3fde8944e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.979611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06903-931f-4d13-94a1-f0c3fde8944e None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:16.980986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 728/1479] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:16.986438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154a84-56a9-47ac-9097-cbe37f639aff None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:16.986858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154a84-56a9-47ac-9097-cbe37f639aff None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:16.987003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd154a84-56a9-47ac-9097-cbe37f639aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.005461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cd154a84-56a9-47ac-9097-cbe37f639aff None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:17.006672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cd154a84-56a9-47ac-9097-cbe37f639aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:17.015032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 752/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:17.058779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06903-931f-4d13-94a1-f0c3fde8944e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:17.073645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06903-931f-4d13-94a1-f0c3fde8944e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:17.079255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:17.079866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:17.080149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:17.080422 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:17.088575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:17.090153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bd694-f817-4fc1-b6ae-bb4ffa020c05 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:17.099903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 729/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:22:19.494084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9607-d2f2-41d2-9afc-82094e1b2d7f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.494647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9607-d2f2-41d2-9afc-82094e1b2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.494647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9607-d2f2-41d2-9afc-82094e1b2d7f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.496063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 753/1482] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:19.501413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1634-cc9c-4651-86c7-c4b88d66f72f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.501856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1634-cc9c-4651-86c7-c4b88d66f72f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.502009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1634-cc9c-4651-86c7-c4b88d66f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.520394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d72f1634-cc9c-4651-86c7-c4b88d66f72f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:19.521598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d72f1634-cc9c-4651-86c7-c4b88d66f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:19.530471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 730/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:19.565301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d9607-d2f2-41d2-9afc-82094e1b2d7f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:19.576570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d9607-d2f2-41d2-9afc-82094e1b2d7f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:19.580087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:19.580720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:19.580998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:19.581272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:19.590768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:19.592249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70aa875-889a-4f7a-8720-4e721beff3f4 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:19.601699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 754/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:22:21.859584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cefbb-c508-45b7-8fcd-7ece8496cd9a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.860109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cefbb-c508-45b7-8fcd-7ece8496cd9a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.860220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cefbb-c508-45b7-8fcd-7ece8496cd9a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.861544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 731/1485] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:21.867625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c65b-b280-414b-8369-379141a02d84 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.868016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c65b-b280-414b-8369-379141a02d84 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.868256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707c65b-b280-414b-8369-379141a02d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.886506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5707c65b-b280-414b-8369-379141a02d84 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:21.887844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5707c65b-b280-414b-8369-379141a02d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:21.895788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 755/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:21.933765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cefbb-c508-45b7-8fcd-7ece8496cd9a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:21.944535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cefbb-c508-45b7-8fcd-7ece8496cd9a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:21.948170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:21.948827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:21.949095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:21.949375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:21.958305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:21.959791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756714a3-f93d-4475-8e57-f49daf1a7b55 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:21.969443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 732/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:22:24.364899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad569-029d-4e7c-9a4d-7e43dd23ca4e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.365461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad569-029d-4e7c-9a4d-7e43dd23ca4e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.365461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad569-029d-4e7c-9a4d-7e43dd23ca4e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.366860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 756/1488] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:24.372847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28db1-ff09-49e6-b687-b4a0d5f333d8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.373300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28db1-ff09-49e6-b687-b4a0d5f333d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.373416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb28db1-ff09-49e6-b687-b4a0d5f333d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.391716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8eb28db1-ff09-49e6-b687-b4a0d5f333d8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:24.392924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8eb28db1-ff09-49e6-b687-b4a0d5f333d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:24.400924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 733/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:24.444411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ad569-029d-4e7c-9a4d-7e43dd23ca4e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:24.455625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ad569-029d-4e7c-9a4d-7e43dd23ca4e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:24.459324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:24.460103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:24.460386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:24.460697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:24.470711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:24.472283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a062b-d513-4106-b2b7-6bcf18d4eb15 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:24.483163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 757/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:22:26.956588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d2d-e339-45ba-93c7-8d3c201c1605 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.957241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d2d-e339-45ba-93c7-8d3c201c1605 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.957241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d2d-e339-45ba-93c7-8d3c201c1605 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.958613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 734/1491] 10.222.0.46 () {54 vars in 926 bytes} [Mon May 23 15:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:22:26.965965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181e7b-3c96-4662-b20a-c549755fddcb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:26.966562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181e7b-3c96-4662-b20a-c549755fddcb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:26.966562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181e7b-3c96-4662-b20a-c549755fddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:26.985898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5d181e7b-3c96-4662-b20a-c549755fddcb None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:22:26.987116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5d181e7b-3c96-4662-b20a-c549755fddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:22:26.996430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 758/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Mon May 23 15:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:22:27.035353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964d2d-e339-45ba-93c7-8d3c201c1605 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:22:27.047118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964d2d-e339-45ba-93c7-8d3c201c1605 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:22:27.050702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:22:27.051440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:22:27.051722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:22:27.052021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:22:27.061969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:22:27.063559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82eca1-b0c2-4d47-8855-e7b56dad1555 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:22:27.073470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 735/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:22:36.980415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=33 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:22:37.068873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=33 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:07.169788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.170349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.170349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.188938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:07.190113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:07.197804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 759/1494] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:24:07.207608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.208121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.208229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.226188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:07.227409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:07.235447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 736/1495] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:24:07.239763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.250130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585db6f-3279-49de-9507-f52f6da59c23 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.254636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.255288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.255602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.255879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.256601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:24:07.256907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.257912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.257912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:24:07.257912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:24:07.258794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.270853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 760/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:24:07.278807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.288556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bb993-3371-43a4-9e9e-635fbb1255a3 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.293225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.293995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.294397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.294816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.295585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.297654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.297654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:24:07.297654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:24:07.298869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.336006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 737/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:24:07.341744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.351829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02570412-c5e9-4e68-8bf3-537d56a66977 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.409136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.409809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.410091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.410367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.411096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.412166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.412166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:24:07.412166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:24:07.413358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.433579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 761/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:24:07.438415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.448579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08afaf-1c37-46c1-bffc-534ae3d90c7e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.453949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.454605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.454889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.455164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.455920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.456946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.456946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:24:07.456946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:24:07.457826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.470600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 738/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:24:07.474419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.485264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752405-cf67-4c29-9826-74a53c5e6d1e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.490042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.490690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.490972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.491246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.492023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.493294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.493294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:24:07.493294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:24:07.494170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a1aea-aa67-4d3f-b115-a7058140e1f7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.508118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 762/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:24:07.512206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.522371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b79dd2-bb65-40af-9cee-abef2772bf99 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.527130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.528057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.528377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.528661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] PATH_INFO: `/v3/projects/9dfd551055ba40aea71384ce4c499764/users/c5854f9c606146faa432d847e0a3ab0c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.543648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfd551055ba40aea71384ce4c499764, user_id=c5854f9c606146faa432d847e0a3ab0c, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.544731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.544731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:24:07.544731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:24:07.547310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afe94-a71c-4abe-af59-aec7403af947 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.560129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 739/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:24:07 2022] PUT /identity/v3/projects/9dfd551055ba40aea71384ce4c499764/users/c5854f9c606146faa432d847e0a3ab0c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:07.571943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f68f-f796-4d52-8056-e02a1523a96f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.572237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f68f-f796-4d52-8056-e02a1523a96f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.572526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f68f-f796-4d52-8056-e02a1523a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.598247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-98e2f68f-f796-4d52-8056-e02a1523a96f None None] MFA Rules not processed for user `c5854f9c606146faa432d847e0a3ab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:07.599502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-98e2f68f-f796-4d52-8056-e02a1523a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:07.670704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 763/1502] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:24:07.684502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc129-c789-4c33-b806-c715ded8cf4f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.684734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc129-c789-4c33-b806-c715ded8cf4f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.685011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc129-c789-4c33-b806-c715ded8cf4f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.686419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 740/1503] 10.222.0.46 () {54 vars in 963 bytes} [Mon May 23 15:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:07.691817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6f00-9b18-426b-874c-e8c664a19441 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.692110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6f00-9b18-426b-874c-e8c664a19441 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.692419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6f00-9b18-426b-874c-e8c664a19441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.710181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f08f6f00-9b18-426b-874c-e8c664a19441 None None] MFA Rules not processed for user `ee8345ccaca544058ac7df6888e6ab9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:07.711412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f08f6f00-9b18-426b-874c-e8c664a19441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:07.755569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:07.763892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 764/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Mon May 23 15:24:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:24:07.772074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc129-c789-4c33-b806-c715ded8cf4f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.782807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc129-c789-4c33-b806-c715ded8cf4f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.786395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.787029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.787310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.787606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.795775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.798045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.806696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 741/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:24:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:24:07.849172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c8b-15b7-4299-982a-572d4a5d7f35 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.849482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c8b-15b7-4299-982a-572d4a5d7f35 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.849746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c8b-15b7-4299-982a-572d4a5d7f35 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.851028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 765/1506] 10.222.0.46 () {52 vars in 829 bytes} [Mon May 23 15:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:24:07.854527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:07.917401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04190e06-031e-40d9-b9e9-acae732689e6 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:07.922665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:07.923569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:07.923853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:07.924127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] PATH_INFO: `/v3/users/c5854f9c606146faa432d847e0a3ab0c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:07.925319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5854f9c606146faa432d847e0a3ab0c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:07.926352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:07.926352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:24:07.926352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:24:07.927590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:07.993728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5854f9c606146faa432d847e0a3ab0c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.006648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5854f9c606146faa432d847e0a3ab0c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.026018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5854f9c606146faa432d847e0a3ab0c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.026860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5854f9c606146faa432d847e0a3ab0c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.031277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:08.036940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5854f9c606146faa432d847e0a3ab0c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.044409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 742/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:24:07 2022] DELETE /identity/v3/users/c5854f9c606146faa432d847e0a3ab0c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:08.049574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.049873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.050217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.068389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:24:08.069641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:08.251304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 766/1508] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:24:08.260682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.262141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:08.320592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2654c-ecb8-4c3d-961a-a0ff431c360a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.325912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.327031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.328113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.328593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.339922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.341389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c746639-1d70-432b-94fc-d799c0da1944 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.351690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 743/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:24:08.780075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:24:08.782220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:24:08.793919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95e168-74f6-4179-8f12-adacbb76ba90 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:24:08.800004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:24:08.800803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:24:08.801086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:24:08.801358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] PATH_INFO: `/v3/projects/9dfd551055ba40aea71384ce4c499764` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:24:08.802542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfd551055ba40aea71384ce4c499764)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:24:08.804174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:24:08.804174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:24:08.804174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:24:08.805406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:24:08.878540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfd551055ba40aea71384ce4c499764', 'request_id': 'req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.884641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfd551055ba40aea71384ce4c499764', 'request_id': 'req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.893886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfd551055ba40aea71384ce4c499764', 'request_id': 'req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.913424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] The token cache is being invalidate because project 9dfd551055ba40aea71384ce4c499764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:24:08.913713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.914355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b0bb869-f0d0-4052-b3ee-dc1163e1ce3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:24:08.916158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 767/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:24:08 2022] DELETE /identity/v3/projects/9dfd551055ba40aea71384ce4c499764 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:24:18.347569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:24:18.910386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:01.024261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:01.024869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:01.024869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:01.026248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:01.031035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2ee7-0f4a-4665-9488-f0c230f5a7d6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:01.031475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2ee7-0f4a-4665-9488-f0c230f5a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:01.031616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec2ee7-0f4a-4665-9488-f0c230f5a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:01.050417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2cec2ee7-0f4a-4665-9488-f0c230f5a7d6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:01.051645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2cec2ee7-0f4a-4665-9488-f0c230f5a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:01.110999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:01.280113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:01.281948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:01.358320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea2110-0b36-4482-9beb-643ad505cf02 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:01.363846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:01.364501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:01.364811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:01.365112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:01.374429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:01.376177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e207a-4727-4e48-9b21-e34432db4c4d service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:01.386188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 745/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:02.262844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b332e-6f91-4ade-964d-ae13390b822f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:02.263409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b332e-6f91-4ade-964d-ae13390b822f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:02.263409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b332e-6f91-4ade-964d-ae13390b822f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:02.264810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:02.269608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7165810-dd7e-4e57-8535-a3a39dcacbff None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:02.270049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7165810-dd7e-4e57-8535-a3a39dcacbff None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:02.270171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7165810-dd7e-4e57-8535-a3a39dcacbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:02.288756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d7165810-dd7e-4e57-8535-a3a39dcacbff None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:02.290719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d7165810-dd7e-4e57-8535-a3a39dcacbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:02.298576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:02.451188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b332e-6f91-4ade-964d-ae13390b822f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:02.465974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b332e-6f91-4ade-964d-ae13390b822f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:02.471553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:02.472189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:02.472471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:02.472747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:02.481327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:02.482898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a100fc3-92d3-41e0-ac04-0df82a71c50a service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:02.492317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 770/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:03.590007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73c01-1368-44ae-9054-7abec3e89994 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:03.590557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73c01-1368-44ae-9054-7abec3e89994 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:03.590557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a73c01-1368-44ae-9054-7abec3e89994 None None] PATH_INFO: `/v3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:03.591915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 747/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon May 23 15:26:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:26:03.599474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6b05-7e2a-4dd5-954c-3e9c7a4539df None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:03.599875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6b05-7e2a-4dd5-954c-3e9c7a4539df None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:03.600035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6b05-7e2a-4dd5-954c-3e9c7a4539df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:03.618111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b82b6b05-7e2a-4dd5-954c-3e9c7a4539df None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:03.619284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b82b6b05-7e2a-4dd5-954c-3e9c7a4539df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:03.680885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 771/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon May 23 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:12.283474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=37 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:13.672390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=62 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:13.767622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329e3d-0e44-4b96-954c-27cb4760ba6f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:13.768089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329e3d-0e44-4b96-954c-27cb4760ba6f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:13.768202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d329e3d-0e44-4b96-954c-27cb4760ba6f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:13.769580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 748/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:13.775299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715feae-afd9-4e65-8983-d7f808556321 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:13.775746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715feae-afd9-4e65-8983-d7f808556321 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:13.776060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715feae-afd9-4e65-8983-d7f808556321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:13.794964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7715feae-afd9-4e65-8983-d7f808556321 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:13.796210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7715feae-afd9-4e65-8983-d7f808556321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:13.804120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 772/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:13.961479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d329e3d-0e44-4b96-954c-27cb4760ba6f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:13.976999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d329e3d-0e44-4b96-954c-27cb4760ba6f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:13.982627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:13.983250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:13.983563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:13.983838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:13.992203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:13.994087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ae811-1333-4cbd-83e5-68e3b2bee858 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:14.003572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 749/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:14.121166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ce61-0f78-420f-9d46-02edf8a0723b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:14.121480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ce61-0f78-420f-9d46-02edf8a0723b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:14.121734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5ce61-0f78-420f-9d46-02edf8a0723b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:14.123120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 773/1522] 10.222.0.46 () {54 vars in 960 bytes} [Mon May 23 15:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:14.128162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc935-547f-452d-ba43-146699e4dc3e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:14.128524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc935-547f-452d-ba43-146699e4dc3e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:14.128875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabc935-547f-452d-ba43-146699e4dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:14.147763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-eeabc935-547f-452d-ba43-146699e4dc3e None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:14.148941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eeabc935-547f-452d-ba43-146699e4dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:14.157715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 750/1523] 10.222.0.46 () {58 vars in 1057 bytes} [Mon May 23 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:14.165905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5ce61-0f78-420f-9d46-02edf8a0723b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:14.179187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5ce61-0f78-420f-9d46-02edf8a0723b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:14.184733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:14.185378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:14.185665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:14.185943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:14.194664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:14.196341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2132a-342d-411b-933c-0cc57bf7db85 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:14.206039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 774/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:14.920440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88c65-993a-49df-b1b9-c281d05d5bd8 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:14.920952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88c65-993a-49df-b1b9-c281d05d5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:14.921061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88c65-993a-49df-b1b9-c281d05d5bd8 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:14.922408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon May 23 15:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:14.927428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325a22-a2ad-4195-af0d-a3016a145d14 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:14.927887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325a22-a2ad-4195-af0d-a3016a145d14 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:14.928031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325a22-a2ad-4195-af0d-a3016a145d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:14.946942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-de325a22-a2ad-4195-af0d-a3016a145d14 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:14.948349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-de325a22-a2ad-4195-af0d-a3016a145d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:14.956421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon May 23 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:26:15.112665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a88c65-993a-49df-b1b9-c281d05d5bd8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:15.127867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a88c65-993a-49df-b1b9-c281d05d5bd8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:15.133524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:15.134695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:15.134985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:15.135262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:15.143597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:15.145226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c513e5-5d2e-4da0-8d36-98fc381305e1 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:15.154596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 752/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:19.391355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:19.391950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:19.391950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:19.393296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:19.398678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e9bf-b733-427c-bf07-b8ba5bd672c4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:19.399149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e9bf-b733-427c-bf07-b8ba5bd672c4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:19.399249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e9bf-b733-427c-bf07-b8ba5bd672c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:19.418197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5184e9bf-b733-427c-bf07-b8ba5bd672c4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:19.419428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5184e9bf-b733-427c-bf07-b8ba5bd672c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:19.427622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:19.465401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:19.467084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:19.527041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2edde-8ab5-4d62-be60-45f06ae5b392 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:19.530751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:19.531429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:19.531716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:19.531993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:19.541028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:19.542451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122eec8-386e-4f40-8d97-29fcdda38426 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:19.551908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 777/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:21.769366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3822-bfd9-4fa1-9410-b311b1c7e06a None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:21.769872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3822-bfd9-4fa1-9410-b311b1c7e06a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:21.769872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3822-bfd9-4fa1-9410-b311b1c7e06a None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:21.771225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:26:21.777149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a414-ac2f-4cec-9e70-6bf7c74f9eb5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:21.777581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a414-ac2f-4cec-9e70-6bf7c74f9eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:21.777725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32a414-ac2f-4cec-9e70-6bf7c74f9eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:21.796492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2d32a414-ac2f-4cec-9e70-6bf7c74f9eb5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:21.797703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2d32a414-ac2f-4cec-9e70-6bf7c74f9eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:21.805579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:21.841853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3822-bfd9-4fa1-9410-b311b1c7e06a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:21.852545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3822-bfd9-4fa1-9410-b311b1c7e06a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:21.856789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:21.857424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:21.857709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:21.857988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:21.867206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:21.868795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cabaa6-2d8d-4c85-8ec8-c971a70a0223 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:21.878316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 755/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:25.963276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:25.963855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:25.963954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:25.965429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:25.970654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1122-2dab-44c1-b3ec-b51da05d969c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:25.971077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1122-2dab-44c1-b3ec-b51da05d969c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:25.971222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1122-2dab-44c1-b3ec-b51da05d969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:25.989568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e71e1122-2dab-44c1-b3ec-b51da05d969c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:25.990764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e71e1122-2dab-44c1-b3ec-b51da05d969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:25.999335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:26:26.274426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:26.276793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:26.334193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9e9a0-6d60-424c-be3e-131381bf2d10 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:26.338424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:26.339165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:26.339480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:26.339758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:26.348549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:26.349973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd65530-77e3-419c-9e56-7a564e39ded9 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:26.360003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 780/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:28.588982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:28.589572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:28.589572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:28.590929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon May 23 15:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:26:28.596606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a273-a606-4ed9-bf5a-2e8e2e9f9473 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:28.597046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a273-a606-4ed9-bf5a-2e8e2e9f9473 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:28.597162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a273-a606-4ed9-bf5a-2e8e2e9f9473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:28.615855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b8e3a273-a606-4ed9-bf5a-2e8e2e9f9473 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:26:28.617050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b8e3a273-a606-4ed9-bf5a-2e8e2e9f9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:28.624929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon May 23 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:26:28.897134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:26:28.898850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:26:28.911829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc602b-6ec6-498f-8214-66598e065dd0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:26:28.915288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:26:28.916536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:26:28.916813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:26:28.917094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:26:28.925944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:26:28.927404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf43cf-4769-42d1-ac52-0570efe2d89c service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:26:28.937451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 758/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:26:38.610672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=70 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:26:38.933322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=33 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:10.225985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.226645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.226645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.255118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.256747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.266771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 782/1540] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.278262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff538-48eb-49e4-8880-cd0fcf5be370 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.278837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff538-48eb-49e4-8880-cd0fcf5be370 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.278944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff538-48eb-49e4-8880-cd0fcf5be370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.306124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7efff538-48eb-49e4-8880-cd0fcf5be370 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.307554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7efff538-48eb-49e4-8880-cd0fcf5be370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.321758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 759/1541] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:10.326852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.338478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e55384-6e84-4af7-bbf2-6f3121c87667 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.347349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.348932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.349610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.350307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.351268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:10.351877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.354003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.354179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee54be-bb57-4059-b5ba-985fc492dcfa None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.354431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee54be-bb57-4059-b5ba-985fc492dcfa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.354948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee54be-bb57-4059-b5ba-985fc492dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.373600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 783/1542] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:10.381929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.386383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-07ee54be-bb57-4059-b5ba-985fc492dcfa None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.388164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-07ee54be-bb57-4059-b5ba-985fc492dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.397847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a2645-3bbd-4fac-8f6d-82d51d8a983f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.402750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 760/1543] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.408277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.409078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.409442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.409797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.411320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.412479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:10.412479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:28:10.412479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:28:10.413871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2c10d-3b0c-4c27-8955-a0e3bac85f21 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.415046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.415683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.416226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.447425 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.449927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.457085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 784/1544] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:28:10.459409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.459409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.459409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.464935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 761/1545] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:10.466266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.485282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284fff-9fb7-4e86-8735-0112c83bd2a2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.500547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.502079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.603777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.605204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.605808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.606414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.607309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.608925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:10.608925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:28:10.608925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:28:10.616036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b2c8-776e-472a-8014-4feaf136e060 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.642976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 785/1546] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.644032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.658814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa3bce-1bfc-484c-beaf-e5cb7fe6e94a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.664024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 762/1547] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:10.665364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.665654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.665934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.669287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.670010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.670300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.670583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.671457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:10.671848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.676560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dacbaa-8d21-41e3-8dcf-c7dc04e4e902 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.702346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 786/1548] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:10.703866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057f0-0169-49f3-bc93-ed963f8dba29 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.704163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057f0-0169-49f3-bc93-ed963f8dba29 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.704449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c057f0-0169-49f3-bc93-ed963f8dba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.711611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.712898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.721537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 763/1549] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.722975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.726614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b1c057f0-0169-49f3-bc93-ed963f8dba29 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.727912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b1c057f0-0169-49f3-bc93-ed963f8dba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.737055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 787/1550] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.739163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5412-5f58-441c-9775-4abbedde8161 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.739490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5412-5f58-441c-9775-4abbedde8161 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.739776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5412-5f58-441c-9775-4abbedde8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.742386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18732e2c-8573-474b-aa05-06ca1f8212de None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.748797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.749738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.750022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.750614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.751348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.753432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780abe4-560d-4581-92f9-79bf0456dc13 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.759124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5e4a5412-5f58-441c-9775-4abbedde8161 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.760359 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5e4a5412-5f58-441c-9775-4abbedde8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.765022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 764/1551] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:10.766315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.766729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.767017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.771614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 788/1552] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.773298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01bee-8f67-4104-8352-60ea6dd7914b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.773788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01bee-8f67-4104-8352-60ea6dd7914b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.774322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01bee-8f67-4104-8352-60ea6dd7914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.790595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.791828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.794889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f8d01bee-8f67-4104-8352-60ea6dd7914b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.796091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8d01bee-8f67-4104-8352-60ea6dd7914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.800264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 765/1553] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.801853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.811402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 789/1554] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.811402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.811402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.811809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.818310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3364-d484-4803-b7b6-0c65238b734c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.828690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.829382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.829668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.829945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.830708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.833524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.835263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.836491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.851175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 790/1555] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.852163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.862207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f99857-872c-4970-bec0-07f4e8ddbb9f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.867324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.868154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.868425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.868705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.868903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 766/1556] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:10.869502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:10.869791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:10.869903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.871420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec044a-896e-4c21-acab-9bf6fe7f576d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.890586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 791/1557] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:10.890586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401800-9bb8-4818-9f51-119def34a5ef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.890586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401800-9bb8-4818-9f51-119def34a5ef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.890586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401800-9bb8-4818-9f51-119def34a5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.904929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c8401800-9bb8-4818-9f51-119def34a5ef None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.906136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c8401800-9bb8-4818-9f51-119def34a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.934554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d0eae-1311-4e69-a01e-a8e78b740be2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:10.939344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:10.940040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.940324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.940599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.941376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:10.943004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9adb-c5ca-45a1-aaf7-bb1dae65de8a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:10.952898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 767/1558] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:10.954110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565befd9-15c7-49bd-9a0d-f2e1740565f6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.954399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565befd9-15c7-49bd-9a0d-f2e1740565f6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.954679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565befd9-15c7-49bd-9a0d-f2e1740565f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.970682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 792/1559] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.972185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.973183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.973518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.974320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-565befd9-15c7-49bd-9a0d-f2e1740565f6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.975704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-565befd9-15c7-49bd-9a0d-f2e1740565f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:10.983816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 768/1560] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:10.985037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:10.985328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:10.985610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:10.988995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:10.991677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:10.993807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:11.002335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 793/1561] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:11.003126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.004313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:11.005484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:11.012832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25f621-0a37-42d6-8d28-fe362472e342 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.013991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 769/1562] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:11.019599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.024251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.024880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5222ee-1921-45ef-9d24-8bd9288e5ab1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.024998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.025182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.025455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.026177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:11.026642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.028291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.029686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.030342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.030623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.030901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.031640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.033572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.040842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 794/1563] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:11.040972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:11.041678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.056825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 770/1564] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.057566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.059134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4d804-f71a-462b-855d-9ea3fc8b88f7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.064090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.064751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.065033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.065309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.066592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.068522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.069436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165493d8-b30c-4819-afdd-0a1731c08db1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.074022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.074891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.075178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.075490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] PATH_INFO: `/v3/projects/c29513d45c0d4a65b5dd7ee42f919a7d/users/6a81fae4b47745aca87c3505b1366df0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.090918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29513d45c0d4a65b5dd7ee42f919a7d, user_id=6a81fae4b47745aca87c3505b1366df0, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.093733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.094200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 795/1565] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.095038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.107575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 771/1566] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:11 2022] PUT /identity/v3/projects/c29513d45c0d4a65b5dd7ee42f919a7d/users/6a81fae4b47745aca87c3505b1366df0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:11.108391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.167148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb9fa-b1a2-44e8-ae2c-bec0c1f459df admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.171854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.172520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.172808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.173090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.173814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:11.174121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.175352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3d7a-f2f5-4c91-a1da-2cf12a99af93 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.175800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.180139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.180794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.181076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.181348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.182064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:11.182677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.183490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:11.183490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:28:11.183490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:28:11.184378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e211218-5f5c-434c-8a55-0126ecd6491c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.187257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 796/1567] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:11.188093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.197002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 772/1568] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:11.198529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.198827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.199107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.200184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db753d-5d38-4c2c-966b-5713e10611d3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.204678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.205334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.205617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.206076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.207012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:11.207279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.208913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.217815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:11.219037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:11.220904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 797/1569] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:11.221680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.228475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 773/1570] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:11.229460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.232333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70145-dacb-4120-9d7c-e1dd84e84880 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.236969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.237831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.238578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.238964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.239846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.241705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81c4f-a1ab-42a9-bfed-0e7bef44dafe admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.242181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef02ff3-d6f4-480f-bab5-8f0d93869d44 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.247194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.247934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.248244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.248550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.249324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.251063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.263066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 774/1571] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:11.264044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.268483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 798/1572] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.270101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.270394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.270816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.274716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d76fc6-f56a-4e8d-8555-4f79029b4f1b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.297572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] MFA Rules not processed for user `6a81fae4b47745aca87c3505b1366df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:11.298792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:11.333197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.334082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.334369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.334691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.335435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.337509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.359972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 775/1573] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.360830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.371130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981a29-f0f5-4503-ace3-3518dac7dd80 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.371862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 799/1574] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:11.372753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.376752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.377414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.377699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.378539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.379647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.381322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.385208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e96f2-6d73-4f65-b7fe-14cfa9e2dff5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.389860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.390576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.390858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.391136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.391866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.394575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.404953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:11.412903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 776/1575] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.413801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.424062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:11.426055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 800/1576] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.427112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.488703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f049070-c355-4455-8c16-5a2740af9eb5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.499100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78e59e-0c55-4cb0-a7dd-df1594b05763 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.504432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.505098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.505380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.505657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.506383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:11.506687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.508314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.521099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 801/1577] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:11.521858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.532168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb113c1-a321-48a4-8fac-4e0f37091cd7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.537136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.537806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.538082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.538364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.539100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.540957 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.555397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 802/1578] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:11.555397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.568951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980445-2d3f-4d3c-904c-7146b9bd7e46 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.570016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.570710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.570989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.571254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.571987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.573713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.573927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.574389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.574806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.575090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.575817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.577747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.600337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 803/1579] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.601183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.607785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 777/1580] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.609231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.615563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e5167-8e18-40c9-a149-3279425d2de1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.671758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1d92-2c50-4ea9-893f-e52c6d791c2e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.676406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.677285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.677574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.677852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.695022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.695759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.696045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.696322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.697054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.698664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.710380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 804/1581] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:11.711217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.723012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe0322-e0fd-4156-8bb2-c79b966d77f0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.727713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.728387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.729170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.729303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.730425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.732667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.740379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:11.743486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.746623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.760251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 805/1582] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.760470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 778/1583] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:11.760575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.760694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.770801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57dfc-1948-413f-af4f-ca987a7589ea admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.772343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58058161-5159-43f0-92fb-eaf2fe67fe2a service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.775966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.776706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.776989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.777266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.777967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.779949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.781840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.782612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.783095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.783943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.784831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.786879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.808654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 806/1584] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.808654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.822733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3106e-b9e4-43dd-8e11-f3021d8ab56c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.827907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.828823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.829108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.829386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] PATH_INFO: `/v3/projects/003cef352f444c88b4777513d2d7781c/users/182c262b5ce8414f9cd022261842e6b8/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.832410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 779/1585] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.833413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.852690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=003cef352f444c88b4777513d2d7781c, user_id=182c262b5ce8414f9cd022261842e6b8, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.853765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:11.853765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:28:11.853765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:28:11.856493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.860198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:11.878141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 807/1586] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:11 2022] PUT /identity/v3/projects/003cef352f444c88b4777513d2d7781c/users/182c262b5ce8414f9cd022261842e6b8/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:11.878766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:11.916909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8dd09-7a9f-49d3-af85-ee610da78639 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.962899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49dd96-7006-4314-86d0-dcea4b3192d5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:11.968097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.969260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.969733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.970082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.972036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.974569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.984674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:11.985613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:11.986143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:11.986657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:11.988326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:11.990210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:11.998452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 808/1587] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:11 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:11.999622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.004003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 780/1588] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.005393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.011998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32b9b3-504a-4c42-91fe-fce6fef7e38b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.016876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962b32-fe80-4eed-bcfc-f21d75b7afc2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.017296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.018914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.019212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.019524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.020261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.021869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.024027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.025182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.025633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.026073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.026968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.029020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.036307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 809/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.036307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.048627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 781/1590] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.048627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.048890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893722-692a-4dd0-a7d0-c8dee21fc951 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.053150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.053836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.054151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.054394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.055124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.056907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c595c1-ffc0-41e9-9a4c-5c5135e37fb1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.061444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ce65-878d-444b-b4f3-971c1334b19d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.068147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.068779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 810/1591] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.068922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.069105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.069383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.070088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.070306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.070600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.070876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.072080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.096862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 782/1592] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/users => generated 295 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:12.100537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.103748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] MFA Rules not processed for user `182c262b5ce8414f9cd022261842e6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.104955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.113730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3feb94-9e85-43fe-8467-bc3b250042cf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.120927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.121671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.121964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.122281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.123124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.124906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.138580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 783/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.139476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.150342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc23d-c5d8-46e6-85b6-d2e7b00d4467 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.155997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.156666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.157060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.157374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.158124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.160085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.172155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 784/1594] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.172771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.185674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b4170-11d7-444b-b6fd-b67d5f764609 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.192618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.193522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.193808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.194083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] PATH_INFO: `/v3/projects/2330a9a724ce4f0d9a64a3c49abd4008/users/0b1d11acf00645ce836267e3871ccd20/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.194217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 811/1595] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:12.195282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.207800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c111f1e-b827-49cf-849a-d276597128b9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.214402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.215798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2330a9a724ce4f0d9a64a3c49abd4008, user_id=0b1d11acf00645ce836267e3871ccd20, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.216184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.216662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.217363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.218308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.219084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.222569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.243293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 812/1597] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.244334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.248683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 785/1597] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/2330a9a724ce4f0d9a64a3c49abd4008/users/0b1d11acf00645ce836267e3871ccd20/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.249696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.255233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:12.258095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851942ca-b1ff-4600-91cb-73f41feed8f7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.311375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:12.327150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305b415-fbd2-4111-9194-1523f24fed7c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.334654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.335828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.336083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.336292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.336746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.336862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.342516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.342516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.342839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.342946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.342946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.343133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.351592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 813/1598] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.352466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.359405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 786/1599] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.359405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.364626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda2dbe-c645-4753-8246-27043beef5cd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.369918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.370613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.370900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.371344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.371970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.373561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819b0d9-d741-4e78-a95b-e48a08079344 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.374072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93875b04-9032-4d02-ad2b-00e88bcf2b00 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.379086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.380138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.380416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.380736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] PATH_INFO: `/v3/projects/95f82759b085437baa9212a576f83fb7/users/9f74a84bdb454996b6790f93f287ab0f/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.390904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 814/1600] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.391545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca42a-7b00-4e51-8dee-fc3297a2f131 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.392024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca42a-7b00-4e51-8dee-fc3297a2f131 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.392988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca42a-7b00-4e51-8dee-fc3297a2f131 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.395682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 815/1601] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 15:28:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:12.397221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca42a-7b00-4e51-8dee-fc3297a2f131 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.398356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f82759b085437baa9212a576f83fb7, user_id=9f74a84bdb454996b6790f93f287ab0f, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.401198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec1466-cad7-494c-b295-877a4f2889e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.421805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca42a-7b00-4e51-8dee-fc3297a2f131 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.424760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 787/1602] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/95f82759b085437baa9212a576f83fb7/users/9f74a84bdb454996b6790f93f287ab0f/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.426851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.427385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.427915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.464988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] MFA Rules not processed for user `0b1d11acf00645ce836267e3871ccd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.466340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.496388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.497296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.497581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.497866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] PATH_INFO: `/v3/projects/de649e3f744649f8961fbda682536115/users/cc2e086bc3464c0fbb6874185925924a/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.528802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de649e3f744649f8961fbda682536115, user_id=cc2e086bc3464c0fbb6874185925924a, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.531729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.550116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 788/1603] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:12.550300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 816/1604] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/de649e3f744649f8961fbda682536115/users/cc2e086bc3464c0fbb6874185925924a/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.551163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.551838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.563614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74eef0-568e-4dfe-8e20-05e07953c463 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.624528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b877897-6553-439d-9243-2364d5ed7ea1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.629357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.630042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.630325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.630599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.631326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.631967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.632871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.632982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.633154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.633432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] PATH_INFO: `/v3/projects/eb85fa7915de4f90a3547e8d5ff93016/users/7dab36eed727491da56525c6b6d385b1/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.638329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:12.647954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 789/1605] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:12.648795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.650125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb85fa7915de4f90a3547e8d5ff93016, user_id=7dab36eed727491da56525c6b6d385b1, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.652879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0552cd1-52df-4579-ae3a-76bee755632f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.659961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381db9-05ad-43b4-9ae3-bf17061f08f9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.664687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.665570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.665855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.666139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] PATH_INFO: `/v3/projects/567ed4de4ecd444a8d86f2ef8328ac23/users/74d565ebc4f141728964939ad751eca6/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.670605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 817/1606] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/eb85fa7915de4f90a3547e8d5ff93016/users/7dab36eed727491da56525c6b6d385b1/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.672037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80186-ae00-4d1f-8904-c14f67387264 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.672322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80186-ae00-4d1f-8904-c14f67387264 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.672598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80186-ae00-4d1f-8904-c14f67387264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.681419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567ed4de4ecd444a8d86f2ef8328ac23, user_id=74d565ebc4f141728964939ad751eca6, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.684155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129da4fa-92b6-4582-b852-bf8ad4d409c7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.694357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-18e80186-ae00-4d1f-8904-c14f67387264 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.696554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-18e80186-ae00-4d1f-8904-c14f67387264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.698727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 790/1607] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/567ed4de4ecd444a8d86f2ef8328ac23/users/74d565ebc4f141728964939ad751eca6/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.700204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.700489 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.700764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.727571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:12.727915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] MFA Rules not processed for user `9f74a84bdb454996b6790f93f287ab0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.729522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.772016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 818/1608] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:12.773334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.773626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.773965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.791839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.793052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.798552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 791/1609] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:12.799498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.861888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 819/1610] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:12.862852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:12.872976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e1e2a-4f77-493d-8990-025eec85b70a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.878168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.879046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.879330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.879639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] PATH_INFO: `/v3/projects/055bf96c290640da8c0670440c132eee/users/4d86a6b64c22467d9852238e50122b17/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.886684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ca34-8b88-425f-a40c-3c4a7095a976 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:12.891483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:12.892336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.892617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.892898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.893584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.894888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] RBAC: Authorizing `identity:create_grant(project_id=055bf96c290640da8c0670440c132eee, user_id=4d86a6b64c22467d9852238e50122b17, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:12.895564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04834c6a-7d36-495b-8b36-7f1372f606dc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.897653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3a02-5f53-401e-ac4d-525260b1986d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:12.911701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 820/1611] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:12 2022] PUT /identity/v3/projects/055bf96c290640da8c0670440c132eee/users/4d86a6b64c22467d9852238e50122b17/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:12.912973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350a06-ef81-4051-a367-e708a2f1fc19 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.913278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350a06-ef81-4051-a367-e708a2f1fc19 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.913541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350a06-ef81-4051-a367-e708a2f1fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.922830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 792/1612] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:12.925346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:12.925772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:12.926057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:12.942490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fa350a06-ef81-4051-a367-e708a2f1fc19 None None] MFA Rules not processed for user `7dab36eed727491da56525c6b6d385b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.943881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fa350a06-ef81-4051-a367-e708a2f1fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.945496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:12.946653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:12.992852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:13.008901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 793/1613] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:13.012852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 821/1614] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:13.013141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.013258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d943c1-2f6c-4250-90eb-83e8b54a3713 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.013258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d943c1-2f6c-4250-90eb-83e8b54a3713 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.013258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d943c1-2f6c-4250-90eb-83e8b54a3713 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.013258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 822/1615] 10.222.0.46 () {54 vars in 961 bytes} [Mon May 23 15:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:13.013593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d943c1-2f6c-4250-90eb-83e8b54a3713 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.049827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:13.078888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d943c1-2f6c-4250-90eb-83e8b54a3713 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.083428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.084086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.084398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.084679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.091913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35e6dd-f375-42f1-a958-86d31d192382 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.093749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.095856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85bb7-2765-4930-a0c9-9ecf6975a0fd service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.098355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.099008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.099291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.099678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.105655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 823/1616] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:13.106964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.107267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.107591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.125333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:13.126554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:13.135914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 824/1617] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:13.136835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.147609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea09fb-6f3c-4065-bd0e-efc1d00063a5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.152768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.153451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.153739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.154176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.154862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.156866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.170829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.172848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23e46c-df05-4ac4-ad5c-563497bcf814 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.180307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 825/1618] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:13.181358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.185992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 794/1619] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:13.187742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.188167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.189337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.193047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7e2b-fe5b-4d16-8d1d-5339dcb4adb9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.199163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.200166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.200637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.201230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.202171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.205376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.212472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:13.213921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:13.230182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 795/1620] 10.222.0.46 () {58 vars in 1058 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:13.231204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.242052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 826/1621] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:13.242052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.243667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153b0e2-4589-42bb-ad32-023d36abef0d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.244303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:13.311918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554aab-966d-43db-8a7c-d86db337d44f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.316149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.317067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.317418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.317875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.334795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.335774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.336198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.336609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.407445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:13.423985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.427617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.443461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 827/1622] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:13.444729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.450557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.453050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.458948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfaf91-2079-402a-a3e3-c024fcd3b4f7 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.464323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.465393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.465729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.466002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.466700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 796/1623] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:13.466827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.467700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.474548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.497684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 828/1624] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:13.498538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.517746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c15c-f7a0-4cee-b334-25593cb3f49c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.535977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.536727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.537015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.537296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.538024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.540131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.583241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 829/1625] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:13.584050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.602422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef757-b6e3-4933-8843-0c0ed21b1b70 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.617646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.618662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.619002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.619289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] PATH_INFO: `/v3/projects/baef637750da47e389e542f8c4538ba9/users/ae4fd0d920344ce9b5aa55d32abe0442/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.622259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe45e5-98b5-4ec6-88cf-cc941ca1f577 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.622910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:13.638875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.640850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.640850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.640850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.645978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baef637750da47e389e542f8c4538ba9, user_id=ae4fd0d920344ce9b5aa55d32abe0442, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.651019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.678647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 830/1626] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:13 2022] PUT /identity/v3/projects/baef637750da47e389e542f8c4538ba9/users/ae4fd0d920344ce9b5aa55d32abe0442/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:13.679734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.753209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.759658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37d4b-c9bf-460b-a997-22321516a4fe service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.778407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 797/1627] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:13.779984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850317ad-1efd-4e0b-a694-94ec1911b2e5 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.780833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850317ad-1efd-4e0b-a694-94ec1911b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.781128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850317ad-1efd-4e0b-a694-94ec1911b2e5 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.783034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 798/1628] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 15:28:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:13.784277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850317ad-1efd-4e0b-a694-94ec1911b2e5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.879940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce4966-d5d4-4231-9f41-e455ccc271c2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.892475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850317ad-1efd-4e0b-a694-94ec1911b2e5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.893459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.894297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.894754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.895116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.896562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.900069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12686b-6c26-4ba5-a78d-5d619b36b1b9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.911243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.912109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.914308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.914671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.915724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:13.917493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:13.927770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 831/1629] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:13.932178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.934773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.935378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:13.941181 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 799/1630] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:13.942025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:13.961719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:13.971009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731e22-5a36-4333-9b04-b6cee5e4430c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:13.972333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:13.974745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:13.981588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:13.982623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:13.984627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:13.985028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] PATH_INFO: `/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639/users/45128fbadeed4a38aae4fd285b92477a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.047524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ddeb782bcf4d91b0c2fb65879ac639, user_id=45128fbadeed4a38aae4fd285b92477a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.050374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.088832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 800/1631] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:13 2022] PUT /identity/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639/users/45128fbadeed4a38aae4fd285b92477a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:14.099786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:14.184646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 832/1632] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:14.188267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:14.207567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7c3b1-8bae-490b-9894-0ba025adff67 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:14.226514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468827d7-2ffc-4143-a592-3ae8b39679fa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:14.232268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:14.233338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.233631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.233912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] PATH_INFO: `/v3/projects/baef637750da47e389e542f8c4538ba9/users/ae4fd0d920344ce9b5aa55d32abe0442/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.236491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] RBAC: Authorizing `identity:create_grant(project_id=baef637750da47e389e542f8c4538ba9, user_id=ae4fd0d920344ce9b5aa55d32abe0442, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.239353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5629f-60fb-41dc-b7bc-8f2e8cf0023d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.254243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 801/1633] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:14 2022] PUT /identity/v3/projects/baef637750da47e389e542f8c4538ba9/users/ae4fd0d920344ce9b5aa55d32abe0442/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:14.255745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f321-f665-4164-adf3-d2713a47bb89 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.256036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f321-f665-4164-adf3-d2713a47bb89 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.256318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f321-f665-4164-adf3-d2713a47bb89 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.267860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 802/1634] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 15:28:14 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:14.268765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f321-f665-4164-adf3-d2713a47bb89 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:14.349889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:14.350496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.350596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.350810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.351723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.361068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec62805-0501-4ed3-8974-74a73d04fc7a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.389736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 833/1635] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:14.391229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.391551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.391834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.413760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91f321-f665-4164-adf3-d2713a47bb89 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:14.417651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:14.419039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.419450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.419804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.421156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:14.444045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] MFA Rules not processed for user `ae4fd0d920344ce9b5aa55d32abe0442`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:14.445852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:14.552267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.554226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d182c0-899f-4ce7-90eb-bdfee8bcf9d1 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.568454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 803/1636] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:14.570573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d5a3-0177-46c9-ab44-d186362cd7f9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.571050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d5a3-0177-46c9-ab44-d186362cd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.571523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d5a3-0177-46c9-ab44-d186362cd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.584227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 834/1637] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:14.584227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:14.634626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6347d5a3-0177-46c9-ab44-d186362cd7f9 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:14.638018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6347d5a3-0177-46c9-ab44-d186362cd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:14.665152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 804/1638] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:14.666976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57cb8-8066-4d53-9fed-c5a51ad5cfbc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.667383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57cb8-8066-4d53-9fed-c5a51ad5cfbc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.667855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce57cb8-8066-4d53-9fed-c5a51ad5cfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.686148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289ad6d-5c47-4319-9adf-a90a413ed1af None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:14.692855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:14.695547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.695855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.696241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] PATH_INFO: `/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639/users/45128fbadeed4a38aae4fd285b92477a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.698392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ddeb782bcf4d91b0c2fb65879ac639, user_id=45128fbadeed4a38aae4fd285b92477a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.699567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:14.702278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.714275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ce57cb8-8066-4d53-9fed-c5a51ad5cfbc None None] MFA Rules not processed for user `cc2e086bc3464c0fbb6874185925924a`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:14.716094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 835/1639] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:14 2022] PUT /identity/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639/users/45128fbadeed4a38aae4fd285b92477a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:14.717220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:14.723605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ce57cb8-8066-4d53-9fed-c5a51ad5cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:14.815152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7392a-cd7c-4768-bf7e-4c5fcee3f895 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:14.829192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:14.830089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.830218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.830426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.835240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 805/1640] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:14.836696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.837040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.837248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.884140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] MFA Rules not processed for user `45128fbadeed4a38aae4fd285b92477a`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:14.885636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:14.919097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:14.952843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:14.955177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1de5-a7a3-4629-9b24-0ebd005010ed service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:14.975781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 806/1642] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:14.984052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 836/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:14.986093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:14.986385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:14.986677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:14.994769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:15.012964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5b43-1f0a-4898-90e1-9437eb48e942 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:15.013183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] MFA Rules not processed for user `cc2e086bc3464c0fbb6874185925924a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:15.017279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:15.021118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:15.022058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:15.022353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:15.022895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:15.059795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 837/1643] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:15.145447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:15.147320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:15.161701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 807/1644] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:15.436300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:15.445010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:15.447926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c44aa-a075-4470-afb8-f6e12930a105 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:15.452909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:15.453918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:15.454415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:15.454950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:15.464032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced3bd8-e510-43f2-8cfe-364e0ed9cbe5 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:15.478032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:15.481371 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:15.487968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:15.488711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:15.488998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:15.489270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:15.496142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:15.504320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:15.507464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 838/1645] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:15.522059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:15.587034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 808/1646] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:15.838989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:15.856010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e66b84-e3f2-4e5a-b011-4806cb590fec service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:15.871004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:15.872162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:15.872630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:15.873011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.032211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:16.033879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffce86-eaee-44df-8eb5-6e3f33751299 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:16.057757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 839/1647] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:16.247751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:16.286449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf6a1-3d71-4f37-9269-8e1fce549c69 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:16.286902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf6a1-3d71-4f37-9269-8e1fce549c69 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:16.287348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf6a1-3d71-4f37-9269-8e1fce549c69 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.288969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 840/1648] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 15:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:16.296986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:16.297635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:16.298077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.425523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:16.429805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:16.484253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9a50c-4618-4a2c-ba43-f585011e7817 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:16.497163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:16.498785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:16.499943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:16.500253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] PATH_INFO: `/v3/users/182c262b5ce8414f9cd022261842e6b8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.503312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=182c262b5ce8414f9cd022261842e6b8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:16.509418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:16.573093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 841/1649] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:16.611940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:16.644601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab80b3-77e4-4cc0-91f6-fac5a0889d4f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:16.644601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:16.645141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:16.645470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:16.645754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.680638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:16.682282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639b49f-28e2-40b2-9d85-a2acd79eb685 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:16.702995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182c262b5ce8414f9cd022261842e6b8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:16.706476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 842/1650] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:16.724611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182c262b5ce8414f9cd022261842e6b8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:16.766735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182c262b5ce8414f9cd022261842e6b8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:16.769984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182c262b5ce8414f9cd022261842e6b8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:16.790948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182c262b5ce8414f9cd022261842e6b8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:16.805867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 809/1651] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:16 2022] DELETE /identity/v3/users/182c262b5ce8414f9cd022261842e6b8 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:16.811659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:16.811950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:16.812231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:16.869393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:16.872123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:17.005923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:17.023766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:17.025638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:17.103277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 843/1652] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:17.145102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:17.166424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:17.235171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb19677-706f-43c4-8920-043ceb176cac admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:17.240869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:17.241780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:17.242069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:17.242348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] PATH_INFO: `/v3/users/7dab36eed727491da56525c6b6d385b1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:17.247968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dab36eed727491da56525c6b6d385b1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:17.258100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:17.280660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:17.329072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dab36eed727491da56525c6b6d385b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:17.339337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dab36eed727491da56525c6b6d385b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:17.344738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad2e8e-6169-4ca8-833a-2f2b9b51777f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:17.356002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dab36eed727491da56525c6b6d385b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:17.357171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dab36eed727491da56525c6b6d385b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:17.357568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:17.358278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:17.358563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:17.358842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:17.371617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9790ca11-46bb-4f98-adca-868976ce7514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dab36eed727491da56525c6b6d385b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:17.398145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 810/1653] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:17 2022] DELETE /identity/v3/users/7dab36eed727491da56525c6b6d385b1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:17.399932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:17.403201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12f1e-f885-4596-b2b1-709d193e7ddd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:17.406405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12f1e-f885-4596-b2b1-709d193e7ddd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:17.406845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c12f1e-f885-4596-b2b1-709d193e7ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:17.407046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:17.455400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 844/1654] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:17.468878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d8c12f1e-f885-4596-b2b1-709d193e7ddd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:17.470537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d8c12f1e-f885-4596-b2b1-709d193e7ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:17.607639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 811/1655] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:17.652408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:17.654637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:17.706032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261781-1a2e-4848-89d6-3ac035d16020 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:17.913615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:17.920575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:17.920950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:17.921239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:17.938975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:17.940658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3488d-daa4-4be2-b622-d3fe30fdb586 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:17.954396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 845/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:18.261705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d235-e445-45f9-9fb6-947a1f5f7083 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:18.262650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d235-e445-45f9-9fb6-947a1f5f7083 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:18.263764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124d235-e445-45f9-9fb6-947a1f5f7083 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:18.265344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 812/1657] 10.222.0.46 () {54 vars in 960 bytes} [Mon May 23 15:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:18.272395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:18.273631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:18.274061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:18.315502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:18.316976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:18.563884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 846/1658] 10.222.0.46 () {58 vars in 1057 bytes} [Mon May 23 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:18.570356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d235-e445-45f9-9fb6-947a1f5f7083 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:18.603043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124d235-e445-45f9-9fb6-947a1f5f7083 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:18.629624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:18.630581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:18.630581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:18.630835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:18.635271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:18.679258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:18.685968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea0369-50dc-47d5-b95f-a17eec7349ed service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:18.725202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 813/1659] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:18.782007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:18.783283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:18.820579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3410-87c1-4009-ad06-afd6cd18db81 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:18.834172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:18.835110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:18.835557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:18.837640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] PATH_INFO: `/v3/projects/003cef352f444c88b4777513d2d7781c` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:18.841736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003cef352f444c88b4777513d2d7781c)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:18.843733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:18.894710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:18.992047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003cef352f444c88b4777513d2d7781c', 'request_id': 'req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.014321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003cef352f444c88b4777513d2d7781c', 'request_id': 'req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.030769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003cef352f444c88b4777513d2d7781c', 'request_id': 'req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.071882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] The token cache is being invalidate because project 003cef352f444c88b4777513d2d7781c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:19.072233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.078705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.084377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 847/1660] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:18 2022] DELETE /identity/v3/projects/003cef352f444c88b4777513d2d7781c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:19.089414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a54b4-2228-4d92-ba47-052bf524bd73 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.089835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a54b4-2228-4d92-ba47-052bf524bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.090328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a54b4-2228-4d92-ba47-052bf524bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.133251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9d1a54b4-2228-4d92-ba47-052bf524bd73 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:19.134799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9d1a54b4-2228-4d92-ba47-052bf524bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:19.159914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:19.161269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:19.400993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 814/1661] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:19.408441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7ddb5-879a-4247-886c-b6f6dbc49ab0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:19.409866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.410269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.410549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.420790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:19.422614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.422909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.423189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] PATH_INFO: `/v3/users/9f74a84bdb454996b6790f93f287ab0f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.426930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f74a84bdb454996b6790f93f287ab0f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:19.430802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: WARNING py.warnings [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:19.430802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: warnings.warn(msg) May 23 15:28:19.430802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: May 23 15:28:19.432150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:19.476711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:19.485381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:19.516155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 815/1662] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:19.518442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:19.539501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bdb61-dd83-43b8-a9fb-0e5108230dfc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:19.561753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:19.562450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.562730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.563004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.563770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:19.564078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:19.565811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:19.615987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 816/1663] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:28:19.617115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:19.631858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:19.652203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f74a84bdb454996b6790f93f287ab0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.664028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab9baf-81b1-4f4d-bee7-6901daa9f5a4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:19.685282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:19.689052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.689645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.692166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.696117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:19.699276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:19.714822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f74a84bdb454996b6790f93f287ab0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.759523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f74a84bdb454996b6790f93f287ab0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.761619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f74a84bdb454996b6790f93f287ab0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.782350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6143b5d6-312a-4652-aa03-4988ad8391d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f74a84bdb454996b6790f93f287ab0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:19.797956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 848/1664] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:19 2022] DELETE /identity/v3/users/9f74a84bdb454996b6790f93f287ab0f => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:19.802621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:19.803941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:19.804374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:19.825171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 817/1665] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:19 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:19.826343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:19.840459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:19.896818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:19.900221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:19.945625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:20.062034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985173f6-a766-4489-8d4d-2ad71d76edc6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:20.070787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:20.071757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.072179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.072592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.074159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:20.080774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:20.092924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 849/1666] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:20.127274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 818/1667] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:19 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:20.131468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:20.146927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9209e-82a1-4ff7-b025-afbb9d4861f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:20.158975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:20.161694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:20.162307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:20.163332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.163776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.164303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.165340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:20.168388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:20.221669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 850/1668] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:20.223034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:20.252344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a4c06-e991-44f9-aabb-f22d92c28801 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:20.259756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:20.261272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.261628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.262190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.262937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:20.264719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:20.317770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 851/1669] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:20.318794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:20.348169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cce5d-d170-4c68-b415-27bd0096da8e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:20.363812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:20.364863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.365149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.365419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] PATH_INFO: `/v3/projects/8b98bab18a1246f6bd541ce612ba9582/users/a1400684bf594731ad931e85ea5f0b48/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.367300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0deca4-73e6-4fe8-967d-b986bef0bb81 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:20.385549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:20.388141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.389717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.390008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.410387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b98bab18a1246f6bd541ce612ba9582, user_id=a1400684bf594731ad931e85ea5f0b48, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:20.415102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac4e08-732e-49e9-b077-2b24ad9a6ed5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:20.432456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:20.440002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:20.442480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 852/1670] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:20 2022] PUT /identity/v3/projects/8b98bab18a1246f6bd541ce612ba9582/users/a1400684bf594731ad931e85ea5f0b48/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:20.456008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:20.456308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:20.456590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:20.492095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 819/1671] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:20.538328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] MFA Rules not processed for user `a1400684bf594731ad931e85ea5f0b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:20.543274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:20.782735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 853/1672] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:20.787106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:20.807467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4c285-09ec-4b9d-94f4-2fbe8833d6b4 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.024665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.025704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.026066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.026380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.027108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.029255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.084902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:21.099148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 820/1673] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:20 2022] POST /identity/v3/projects => generated 377 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:21.102616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.168613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32609e-dba8-46f0-874f-475e43800121 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.437571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.438497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.439005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.439281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.440142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.442335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.468148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:21.471069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.473623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:21.487320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 854/1674] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:21 2022] POST /identity/v3/users => generated 295 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:21.493250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.512531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e934792-5ae7-4104-ba14-b14cf5c9e967 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.524560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bdfea-6e25-4798-99ff-6af71a9d456d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.534224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.535451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.535451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.535700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] PATH_INFO: `/v3/projects/eb85fa7915de4f90a3547e8d5ff93016` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.539753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.540970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.541230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb85fa7915de4f90a3547e8d5ff93016)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.541735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.542319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.543386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.544847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: WARNING py.warnings [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 23 15:28:21.544847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: warnings.warn(msg) May 23 15:28:21.544847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: May 23 15:28:21.545764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.550901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.573480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 855/1675] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:21.577326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.602344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834d17-e771-4cd8-9f51-f285b7a5a131 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.615271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.616306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.616645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.616928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] PATH_INFO: `/v3/projects/acd3f98286214b2094f415d37bfe0a77/users/b4ccac9f41d449ca84a43974fe3e3deb/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.650789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd3f98286214b2094f415d37bfe0a77, user_id=b4ccac9f41d449ca84a43974fe3e3deb, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.653923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.685395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 856/1676] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:21 2022] PUT /identity/v3/projects/acd3f98286214b2094f415d37bfe0a77/users/b4ccac9f41d449ca84a43974fe3e3deb/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:21.689199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.825609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa517c-062e-4299-af58-14c2713fc751 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.831435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.832308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.833215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.833215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.833784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.835951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.848389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 857/1677] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:21.856178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:21.868225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967d5f-5db1-4f5e-b659-a3eba04f5b4b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:21.875298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:21.877042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.877588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.878070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] PATH_INFO: `/v3/projects/acd3f98286214b2094f415d37bfe0a77/users/b4ccac9f41d449ca84a43974fe3e3deb/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:21.888890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd3f98286214b2094f415d37bfe0a77, user_id=b4ccac9f41d449ca84a43974fe3e3deb, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:21.892113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440423-6c23-4fbc-a642-ff53ed21bd60 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:21.913125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 858/1678] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:21 2022] PUT /identity/v3/projects/acd3f98286214b2094f415d37bfe0a77/users/b4ccac9f41d449ca84a43974fe3e3deb/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:21.939125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:21.939452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:21.939742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:22.026381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] MFA Rules not processed for user `b4ccac9f41d449ca84a43974fe3e3deb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:22.029544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:22.069441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb85fa7915de4f90a3547e8d5ff93016', 'request_id': 'req-6578d139-19da-4cf8-82b8-5d8318a0a527'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.087996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb85fa7915de4f90a3547e8d5ff93016', 'request_id': 'req-6578d139-19da-4cf8-82b8-5d8318a0a527'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.111061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb85fa7915de4f90a3547e8d5ff93016', 'request_id': 'req-6578d139-19da-4cf8-82b8-5d8318a0a527'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.170039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] The token cache is being invalidate because project eb85fa7915de4f90a3547e8d5ff93016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:22.173277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.175160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.177740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 821/1679] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:21 2022] DELETE /identity/v3/projects/eb85fa7915de4f90a3547e8d5ff93016 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:22.183921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:22.187752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:22.196719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 859/1680] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:22.210679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:22.214719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:22.303157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:22.378302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56788c-fbc1-45d4-89f3-f61e0985d50d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:22.388557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:22.390077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:22.390615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:22.391734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:22.396352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:22.437019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578d139-19da-4cf8-82b8-5d8318a0a527 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:22.458266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:22.459175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:22.459538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:22.459821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] PATH_INFO: `/v3/users/45128fbadeed4a38aae4fd285b92477a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:22.463125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45128fbadeed4a38aae4fd285b92477a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:22.465152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:22.583836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:22.588372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45128fbadeed4a38aae4fd285b92477a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.590014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:22.609022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45128fbadeed4a38aae4fd285b92477a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.620719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 860/1681] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:22.623315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:22.626452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:22.632902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45128fbadeed4a38aae4fd285b92477a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.634467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45128fbadeed4a38aae4fd285b92477a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.649394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a8499500-f778-4e9a-95dd-ad07101d9379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45128fbadeed4a38aae4fd285b92477a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.662247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94abd-5b26-45e7-96b2-887d9b616558 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:22.685090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:22.686263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:22.688377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:22.688848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:22.689293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] PATH_INFO: `/v3/projects/95f82759b085437baa9212a576f83fb7` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:22.703817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f82759b085437baa9212a576f83fb7)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:22.703999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 822/1682] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:22 2022] DELETE /identity/v3/users/45128fbadeed4a38aae4fd285b92477a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:22.722977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:22.916093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f82759b085437baa9212a576f83fb7', 'request_id': 'req-624a7523-6e66-460e-bd8e-d3b083b42001'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.952890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f82759b085437baa9212a576f83fb7', 'request_id': 'req-624a7523-6e66-460e-bd8e-d3b083b42001'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:22.985820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f82759b085437baa9212a576f83fb7', 'request_id': 'req-624a7523-6e66-460e-bd8e-d3b083b42001'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:23.011039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] The token cache is being invalidate because project 95f82759b085437baa9212a576f83fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:23.011336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:23.013309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-624a7523-6e66-460e-bd8e-d3b083b42001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:23.028142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 861/1683] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:22 2022] DELETE /identity/v3/projects/95f82759b085437baa9212a576f83fb7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:23.033840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.034898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.035352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.121909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:23.129574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:23.325218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 823/1684] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:23.333165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8daf-75a4-461d-8481-4a31fb4872fb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.333732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8daf-75a4-461d-8481-4a31fb4872fb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.334242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8daf-75a4-461d-8481-4a31fb4872fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.386709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-30dc8daf-75a4-461d-8481-4a31fb4872fb None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:23.401667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-30dc8daf-75a4-461d-8481-4a31fb4872fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:23.416932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 862/1685] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:23.421061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:23.435043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1726db-8727-4652-8b06-4b83f8e8396a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:23.441763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.442047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.442336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.454340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:23.455493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.456104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.459865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.461643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:23.463466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:23.468639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:23.480135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:23.484188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:23.513701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 824/1686] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:23.515920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:23.543559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903eb37-180e-49e5-b885-11bdc3cb05b4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:23.571987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:23.575045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.575940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.590622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.596047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:23.607581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:23.659495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 863/1687] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:23.675826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 825/1688] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:23 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:23.681580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:23.691650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:23.701722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245695e-9fdd-4811-940b-35820b18de41 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:23.873227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:23.875946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.876328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.876527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.878392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:23.884912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:23.938996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 864/1689] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:23 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:23.942599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:23.964496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:23.966708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636e17d-87e2-495b-8b9e-1bef0d29824c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:23.968357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:23.992302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:23.993232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:23.993523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:23.995617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:23.997538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:23.999201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b21d78-3950-4b7c-a609-2bdee157f065 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:24.041408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 826/1690] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:24.042922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.043219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.043524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.096277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] MFA Rules not processed for user `74d565ebc4f141728964939ad751eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:24.098072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:24.140544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d4ab-f0f0-47c3-9766-e438203e3a92 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:24.153455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:24.154141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.154554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.154848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.203501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 827/1691] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:24.204507 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:24.218792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f29c6-9b73-4468-a5d3-2812c15888ca None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:24.227275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:24.228411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.228692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.228984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.229801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:24.232095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40948a-fdbe-4411-a2ba-e7d50b2c5be4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:24.249732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 828/1692] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:24.251183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.251541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.251862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.282056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] MFA Rules not processed for user `74d565ebc4f141728964939ad751eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:24.283906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:24.292034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:24.293646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:24.295245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 829/1693] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:24.296116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:24.313605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd048-3eb9-4941-95b1-dc891c2dc5b8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:24.317054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 865/1694] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:28:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 23 15:28:24.321031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:24.322092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.322368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.322691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] PATH_INFO: `/v3/projects/d835ba4407af428f8d08c7fb6db32a4f/users/287c886ee7b540a2b81b03a23883eead/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.326928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:24.334261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:24.382668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835ba4407af428f8d08c7fb6db32a4f, user_id=287c886ee7b540a2b81b03a23883eead, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:24.386618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:24.422086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 830/1695] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:24 2022] PUT /identity/v3/projects/d835ba4407af428f8d08c7fb6db32a4f/users/287c886ee7b540a2b81b03a23883eead/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:24.423865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:24.425963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:24.441218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:24.504888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:24.599278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1c2aa-9ba8-4ed7-b4d9-c59db720855e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:24.605920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:24.607755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.608212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.608478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] PATH_INFO: `/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.609943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ddeb782bcf4d91b0c2fb65879ac639)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:24.612309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:24.686108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ddeb782bcf4d91b0c2fb65879ac639', 'request_id': 'req-d528f125-81e5-4383-bfbb-73d6e16ea0c3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:24.698559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ddeb782bcf4d91b0c2fb65879ac639', 'request_id': 'req-d528f125-81e5-4383-bfbb-73d6e16ea0c3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:24.715015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ddeb782bcf4d91b0c2fb65879ac639', 'request_id': 'req-d528f125-81e5-4383-bfbb-73d6e16ea0c3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:24.742669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] The token cache is being invalidate because project e5ddeb782bcf4d91b0c2fb65879ac639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:24.743224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:24.744989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d528f125-81e5-4383-bfbb-73d6e16ea0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:24.747327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 831/1696] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:24 2022] DELETE /identity/v3/projects/e5ddeb782bcf4d91b0c2fb65879ac639 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:24.749959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742c78-054c-41c2-b6d3-f9b1a529f605 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:24.750459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742c78-054c-41c2-b6d3-f9b1a529f605 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:24.751101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742c78-054c-41c2-b6d3-f9b1a529f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:24.776237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376887a-74c8-481b-bdaf-057def6cd690 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:24.791814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7e742c78-054c-41c2-b6d3-f9b1a529f605 None None] MFA Rules not processed for user `287c886ee7b540a2b81b03a23883eead`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:24.796306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7e742c78-054c-41c2-b6d3-f9b1a529f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.019204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 832/1697] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:25.021688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.022053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.025821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.063241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:25.064935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.106079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:25.233717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 833/1698] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:25.235505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:25.244343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.267021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:25.267021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.267021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.267021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.277188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.306403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa64a11-a78d-4b49-b311-65fc56458608 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:25.341037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:25.341729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.342019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.342296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.343002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:25.352613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:25.405723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 834/1699] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:25 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:25.406744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:25.409275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.542780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:25.551873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5fd7b-5218-4afb-bf2e-ddd219e817be service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:25.609222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 866/1700] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:25.614016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.617205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.618387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.636670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e03ba-43bf-4a8b-99c0-cc525a2e864a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:25.665615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:25.666665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.666973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.667258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] PATH_INFO: `/v3/users/6a81fae4b47745aca87c3505b1366df0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.671488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a81fae4b47745aca87c3505b1366df0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:25.685033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:25.717650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:25.719436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.798251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 867/1701] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:25.802460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:25.805024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a81fae4b47745aca87c3505b1366df0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:25.816424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a81fae4b47745aca87c3505b1366df0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:25.837328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a81fae4b47745aca87c3505b1366df0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:25.838292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a81fae4b47745aca87c3505b1366df0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:25.843108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489e07-fae8-4433-a362-9865f3b4f3fe None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:25.870557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:25.871312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a81fae4b47745aca87c3505b1366df0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:25.874097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.878856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.879748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:25.882099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:25.884411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da25ec-2bf7-4046-93f2-a9bdb66efbcd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:25.885932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 835/1702] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:25 2022] DELETE /identity/v3/users/6a81fae4b47745aca87c3505b1366df0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:25.886966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:25.888716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:25.949207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:25.956829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 868/1703] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:25 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:25.959889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:25.960201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:25.961795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.028320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:26.028320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:26.054547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368cea6-91fc-46a2-888e-d5ad8feab289 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.063530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.065141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.065765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.066485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.068408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:26.068408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.070619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.092518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 836/1704] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:26.092518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.094593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:26.112966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed29e6-1ac9-4ec6-b290-0dbe27a8cb57 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.129622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.130417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.131031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.148357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.149221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.152010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:26.155065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.173546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 837/1705] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:26.173546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.186421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23234f2-0495-41ca-ab0e-0fe3fa80dba4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.192201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.193406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.194016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.194130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.195184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.197960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.204926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 869/1706] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:26.205941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.284314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e33d4f-4dd8-4350-8c68-5d0e47af2374 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.306365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.311834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.328168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.328893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] PATH_INFO: `/v3/projects/bc2b2b6f71fd48cd97433c78259e6512/users/6e5e855eefc842b8a20f2dcf4e336ec3/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.333930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 838/1707] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:26 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:26.334941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.339185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:26.397195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b2b6f71fd48cd97433c78259e6512, user_id=6e5e855eefc842b8a20f2dcf4e336ec3, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.400736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.444648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 870/1708] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:26 2022] PUT /identity/v3/projects/bc2b2b6f71fd48cd97433c78259e6512/users/6e5e855eefc842b8a20f2dcf4e336ec3/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:26.447292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.451912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:26.483969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7841a-3f06-4f96-803d-ce41e7b42080 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.628333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ad5f6-6170-44fd-bf8a-29294450cdf5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.635414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.636723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.637365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.638595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.639540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.640528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.641677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.642546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.646779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:26.776907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:26.809972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.814165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.814508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.816085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.860104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 839/1709] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:26.861400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.881392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 871/1710] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:26.882586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:26.912088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228568cb-f2cc-4ca7-b988-31bdb3d2e444 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.915966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e5be4-aaf4-4b23-be16-12bb6e2d0836 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:26.934296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.940706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:26.941619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.942267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:26.943959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.944424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:26.944804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.945466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:26.946356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.947230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:26.951626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.953091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:26.985036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 872/1711] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:26.991770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.022260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 840/1712] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:26 2022] POST /identity/v3/users => generated 304 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:27.024774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8be58-02ce-4c98-a23c-1993a47b9b6e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.025949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.060730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.063515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.063515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.063515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] PATH_INFO: `/v3/projects/bc2b2b6f71fd48cd97433c78259e6512/users/6e5e855eefc842b8a20f2dcf4e336ec3/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.068994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2b2b6f71fd48cd97433c78259e6512, user_id=6e5e855eefc842b8a20f2dcf4e336ec3, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.072106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a3771-f339-418b-a88b-5121d2e21deb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:27.085379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c4597-835f-4992-b1f6-f3570720efda admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.102863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.103682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.103989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.104291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.105052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.106386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 873/1713] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:26 2022] PUT /identity/v3/projects/bc2b2b6f71fd48cd97433c78259e6512/users/6e5e855eefc842b8a20f2dcf4e336ec3/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:27.116353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:27.117472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.117977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.118512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.161509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 841/1714] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:27.168468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.183758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] MFA Rules not processed for user `6e5e855eefc842b8a20f2dcf4e336ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:27.185099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:27.193060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f88a5f-9115-4f1e-b9b6-529e3b5c8512 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.279403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:27.368628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 874/1715] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:27.409316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.463062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.464371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.464371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.464567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.466540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.472630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:27.511437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 842/1716] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:27.511437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.534901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f91c5-2c38-4d0f-b20e-d98e9c31659e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.555353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.557722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.558013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.558300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] PATH_INFO: `/v3/projects/e291826ca2034fca9e10829f80434a45/users/cbfd2926264442268960ddb9ca47a4fd/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.572353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad33c3-8db2-47d6-afc0-a6d05afab1dc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.583234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.584283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.584779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.585269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.592145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e291826ca2034fca9e10829f80434a45, user_id=cbfd2926264442268960ddb9ca47a4fd, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.597896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71183e2f-921e-41ee-9b33-e72a3a709f6a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:27.622410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.627232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:27.645872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 843/1717] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:27 2022] PUT /identity/v3/projects/e291826ca2034fca9e10829f80434a45/users/cbfd2926264442268960ddb9ca47a4fd/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:27.653375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.653677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.653999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.660463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 875/1718] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:27.661816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:27.667713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:27.703735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d1b-914c-436c-855d-3394e92da498 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:27.833014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] MFA Rules not processed for user `cbfd2926264442268960ddb9ca47a4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:27.842042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:27.875765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:27.876599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:27.876881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:27.877247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] PATH_INFO: `/v3/projects/c29513d45c0d4a65b5dd7ee42f919a7d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:27.882130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29513d45c0d4a65b5dd7ee42f919a7d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:27.884655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:28.009533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29513d45c0d4a65b5dd7ee42f919a7d', 'request_id': 'req-df2d4ab8-bcde-4926-9482-699f24bb1ef4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:28.023996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29513d45c0d4a65b5dd7ee42f919a7d', 'request_id': 'req-df2d4ab8-bcde-4926-9482-699f24bb1ef4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:28.044009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29513d45c0d4a65b5dd7ee42f919a7d', 'request_id': 'req-df2d4ab8-bcde-4926-9482-699f24bb1ef4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:28.071876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] The token cache is being invalidate because project c29513d45c0d4a65b5dd7ee42f919a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:28.072169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:28.073074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df2d4ab8-bcde-4926-9482-699f24bb1ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:28.078144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 876/1719] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:27 2022] DELETE /identity/v3/projects/c29513d45c0d4a65b5dd7ee42f919a7d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:28.083819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40d4b-258a-46dd-8f84-771f74addb64 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:28.084137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40d4b-258a-46dd-8f84-771f74addb64 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:28.084422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd40d4b-258a-46dd-8f84-771f74addb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:28.133091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:28.147526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ffd40d4b-258a-46dd-8f84-771f74addb64 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:28.148809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ffd40d4b-258a-46dd-8f84-771f74addb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:28.246520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 844/1720] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 600 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:28.254364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:28.255252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:28.349736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf8324-d632-444e-8bcf-4244aa2d8816 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:28.433672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:28.465011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 877/1721] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:28.468009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:28.468400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:28.468749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:28.582072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:28.589303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:28.614949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:28.621501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 878/1722] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:28.632705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:28.632839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:28.633850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:28.634505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:28.636381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:28.647728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:28.669741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f46dae-c95e-47cb-821c-4dd8c1c2c0ab None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:28.708262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:28.714908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:28.714908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:28.714908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:28.714908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:28.714908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:28.716392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:28.748522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 879/1723] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:28.752673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 845/1724] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:28 2022] POST /identity/v3/projects => generated 409 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:28.759834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:28.761900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:28.834358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3946d-57d6-424d-aa6f-b1f040aba08c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.131538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.138304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.140919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.142559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.149768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.166265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.173914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbd99-a623-4e38-b85e-66fbcd9e4810 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.218034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.220020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.221563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.223323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.225862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.232815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939ee5b-47dd-45fb-a7e3-73c95a4694ab admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.314646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 846/1725] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:28 2022] POST /identity/v3/users => generated 311 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:29.314646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.314646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.321099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.341326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 880/1726] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:28 2022] POST /identity/v3/projects => generated 383 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:29.342288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:29.418662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:29.426118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:29.569321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e182-1414-48ee-b0b9-0d81e2d49550 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.587324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.588852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.589152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.589431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.590454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.594679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.629058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 881/1727] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:29.632086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:29.662946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f32f1-41ea-4d4c-b2d8-4e739f2e8407 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.683279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 847/1728] 10.222.0.70 () {58 vars in 1015 bytes} [Mon May 23 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:29.683279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:29.690981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.692241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.692966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.693463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.697474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.703287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.720637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeca7c-da32-4ae8-831a-21a73a5a2d7d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.726312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:29.734245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.738629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.741118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.742766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] PATH_INFO: `/v3/projects/4c0af137a5b841ddb638d02fc5273d61/users/85f4203bd32e479a8523d495f9335a83/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.755538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 882/1729] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:29 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:29.759085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:29.766516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:29.787137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0af137a5b841ddb638d02fc5273d61, user_id=85f4203bd32e479a8523d495f9335a83, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.794589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.799651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a6dcb-998e-43bf-baf4-daa66523cceb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:29.816712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:29.817960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:29.818336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:29.818705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] PATH_INFO: `/v3/users/287c886ee7b540a2b81b03a23883eead` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:29.823194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=287c886ee7b540a2b81b03a23883eead)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:29.825481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:29.835173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 848/1730] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:29 2022] PUT /identity/v3/projects/4c0af137a5b841ddb638d02fc5273d61/users/85f4203bd32e479a8523d495f9335a83/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:29.835173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:29.886080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:29.968810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287c886ee7b540a2b81b03a23883eead'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:30.016461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287c886ee7b540a2b81b03a23883eead'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:30.034714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287c886ee7b540a2b81b03a23883eead'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:30.036663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287c886ee7b540a2b81b03a23883eead'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:30.037228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8fe2a-54fb-4be6-bb6b-b87f47de545f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.049406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.050428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.050957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.051351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.062927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.063155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287c886ee7b540a2b81b03a23883eead'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:30.063231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.070158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 883/1731] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:29 2022] DELETE /identity/v3/users/287c886ee7b540a2b81b03a23883eead => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:30.072323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.075827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.086587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 849/1732] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:30.086587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.096705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.209088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec59ed5-e0ce-4912-8cf5-8ae4eeb9b047 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.229692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899eff5-509b-4106-8b64-b5337ebac1cb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.232624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.233587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.233667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.234208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.234954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.237394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a6ec-61da-4bee-a9ab-ecbc58ab30d3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.279656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 884/1733] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:30.284452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.284744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.285031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.328798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:30.330153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.374636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 885/1734] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:30.375682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.379961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.400610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.404928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.407480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.407914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.414618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.424750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad26a07-1978-4c88-a73d-e3d0dc230d9c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.437821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.439713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.441768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.442126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.443019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.447555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.448845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.454396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.478066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 850/1735] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:30.485296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 886/1736] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:30.488726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.490238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.495323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.519168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98767-08a0-49b7-826e-3835be23b099 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.532654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f2ad9-7f08-4faf-8177-1bbf922ca616 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.534917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.536300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.538530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.540752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] PATH_INFO: `/v3/projects/4c0af137a5b841ddb638d02fc5273d61/users/85f4203bd32e479a8523d495f9335a83/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.543737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.545659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0af137a5b841ddb638d02fc5273d61, user_id=85f4203bd32e479a8523d495f9335a83, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.546196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.547222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.547666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.555444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c9de4-ed2c-422c-9fad-4b348a03632f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.565131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.566916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.586661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 887/1737] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:30.588505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:30.607825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 851/1738] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:30 2022] PUT /identity/v3/projects/4c0af137a5b841ddb638d02fc5273d61/users/85f4203bd32e479a8523d495f9335a83/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:30.620725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a6537-3ef0-4035-be1a-b867ea19f2f5 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:30.623081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a1d4-18e5-4900-9e75-205306444e20 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.623663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a1d4-18e5-4900-9e75-205306444e20 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.623874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a1d4-18e5-4900-9e75-205306444e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.695216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-01c0a1d4-18e5-4900-9e75-205306444e20 None None] MFA Rules not processed for user `85f4203bd32e479a8523d495f9335a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:30.698327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01c0a1d4-18e5-4900-9e75-205306444e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:30.726281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:30.876108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:30.879334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.879872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.881503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] PATH_INFO: `/v3/projects/399385f78bb1459baec798bc0c23c2be/users/f6d094a2b066416abb1ca20ab85edf6e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.890101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:30.938538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=399385f78bb1459baec798bc0c23c2be, user_id=f6d094a2b066416abb1ca20ab85edf6e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:30.941941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:30.967772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 852/1739] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:30.969231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5a5d-cc9f-4eca-aa69-ccf51ea752c0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:30.969571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5a5d-cc9f-4eca-aa69-ccf51ea752c0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:30.970408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5a5d-cc9f-4eca-aa69-ccf51ea752c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:30.990867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 888/1740] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:30 2022] PUT /identity/v3/projects/399385f78bb1459baec798bc0c23c2be/users/f6d094a2b066416abb1ca20ab85edf6e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:30.992191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:31.000284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.056901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dc6e5a5d-cc9f-4eca-aa69-ccf51ea752c0 None None] MFA Rules not processed for user `4d86a6b64c22467d9852238e50122b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:31.056901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dc6e5a5d-cc9f-4eca-aa69-ccf51ea752c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.259399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b7230-305e-4e8a-a0f0-e09ed1d29b6e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:31.272078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:31.275423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:31.276033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:31.278924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:31.400166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 853/1741] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:31.406455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:31.418773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:31.419224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:31.465651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:31.469227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97460fe2-6325-4409-bc23-a00d65d7e82e service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:31.520121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 889/1742] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:31.521741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:31.529153 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:31.531257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:31.540102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] MFA Rules not processed for user `f6d094a2b066416abb1ca20ab85edf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:31.541347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.592170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] MFA Rules not processed for user `74d565ebc4f141728964939ad751eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:31.596953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.859053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 890/1743] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:31.859975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:31.866269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.883124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 854/1744] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:31.884204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:31.890247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:31.904048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:32.272070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42a09-09eb-40f6-882b-a6de51b1936d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:32.299093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb33b-3f16-411d-86e5-cf24690d3606 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:32.320255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:32.321242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:32.329938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:32.330241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] PATH_INFO: `/v3/projects/d835ba4407af428f8d08c7fb6db32a4f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:32.343151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d835ba4407af428f8d08c7fb6db32a4f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:32.346474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:32.357727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:32.359178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:32.360877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:32.361993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:32.419987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:32.420323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:32.430963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:32.493556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 891/1745] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:32.507421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:32.555393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a7d7b-c61e-447f-8fbc-7fff207a6e81 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:32.578016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:32.579398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:32.580617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:32.581158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:32.582267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:32.595450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:32.613259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd835ba4407af428f8d08c7fb6db32a4f', 'request_id': 'req-e7d3d40a-a2d3-49b0-a149-ce1196691b60'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:32.638958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd835ba4407af428f8d08c7fb6db32a4f', 'request_id': 'req-e7d3d40a-a2d3-49b0-a149-ce1196691b60'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:32.654645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd835ba4407af428f8d08c7fb6db32a4f', 'request_id': 'req-e7d3d40a-a2d3-49b0-a149-ce1196691b60'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:32.679134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 892/1746] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:32 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:32.679134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:32.689444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:32.694086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] The token cache is being invalidate because project d835ba4407af428f8d08c7fb6db32a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:32.694397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:32.698787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:32.707816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 855/1747] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:31 2022] DELETE /identity/v3/projects/d835ba4407af428f8d08c7fb6db32a4f => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:32.708718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:32.713993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:32.888070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dede-fb69-4dae-8550-a47d2bcd1881 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:32.900932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:32.901630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:32.901918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:32.902201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:32.913389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:32.933000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d40a-a2d3-49b0-a149-ce1196691b60 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:33.073030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:33.073726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.075155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.076493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.077234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.082711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.129222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.133992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.147064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 856/1748] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:32 2022] POST /identity/v3/users => generated 298 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:33.147064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:33.147629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:33.171903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 893/1749] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:33.172824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:33.184452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63723b93-2014-4417-933a-ae19aade6ecd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:33.194437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649eb4d7-9251-40ef-ad64-78096082dcfe service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:33.199044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:33.200741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.201696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.201989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] PATH_INFO: `/v3/users/6e5e855eefc842b8a20f2dcf4e336ec3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.205151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5e855eefc842b8a20f2dcf4e336ec3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.209410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.212584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:33.213420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.215189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.215782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.220750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.225349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.253222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 894/1750] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:33.258478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:33.306276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d88d-7898-439d-a21c-8edf29cbf412 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:33.310141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:33.328191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:33.329707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.335626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.337388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] PATH_INFO: `/v3/projects/d1d2cbf7ab294712b0b962b795f19a08/users/41ce0f525e794b78a8117dd2937d20a0/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.384026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5e855eefc842b8a20f2dcf4e336ec3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:33.395469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:33.421026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d2cbf7ab294712b0b962b795f19a08, user_id=41ce0f525e794b78a8117dd2937d20a0, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.431159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.434097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5e855eefc842b8a20f2dcf4e336ec3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:33.502067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 895/1751] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:33 2022] PUT /identity/v3/projects/d1d2cbf7ab294712b0b962b795f19a08/users/41ce0f525e794b78a8117dd2937d20a0/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:33.504992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:33.511150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5e855eefc842b8a20f2dcf4e336ec3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:33.518201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5e855eefc842b8a20f2dcf4e336ec3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:33.548777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-629f684c-51d7-4e71-bfc0-0dc4c31acfaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5e855eefc842b8a20f2dcf4e336ec3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:33.576421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 857/1752] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:33 2022] DELETE /identity/v3/users/6e5e855eefc842b8a20f2dcf4e336ec3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:33.709515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d2c6-002f-4c63-8373-99772f001146 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:33.887804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:33.888503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.888792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.889805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.890243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:33.891927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:33.905161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fef59-7a58-4a64-9c4e-7dc464c89f27 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.906160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fef59-7a58-4a64-9c4e-7dc464c89f27 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.906452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fef59-7a58-4a64-9c4e-7dc464c89f27 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.908779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 858/1753] 10.222.0.46 () {54 vars in 912 bytes} [Mon May 23 15:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:33.918837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77859bb-3f5b-47b2-83c3-1f74342dff75 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:33.919616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77859bb-3f5b-47b2-83c3-1f74342dff75 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:33.919616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77859bb-3f5b-47b2-83c3-1f74342dff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:33.945363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 896/1754] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:33.948361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:33.961620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:33.998869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c77859bb-3f5b-47b2-83c3-1f74342dff75 None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:34.005921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c77859bb-3f5b-47b2-83c3-1f74342dff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:34.013711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a41ed-1943-4de7-8121-be5f2935ca46 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:34.026806 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:34.027852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.028226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.028594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] PATH_INFO: `/v3/projects/d1d2cbf7ab294712b0b962b795f19a08/users/41ce0f525e794b78a8117dd2937d20a0/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.035736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d2cbf7ab294712b0b962b795f19a08, user_id=41ce0f525e794b78a8117dd2937d20a0, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:34.039383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda8727-2500-41a2-ab83-23fab07853e9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:34.073065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 897/1755] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:33 2022] PUT /identity/v3/projects/d1d2cbf7ab294712b0b962b795f19a08/users/41ce0f525e794b78a8117dd2937d20a0/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:34.086119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e606d7-b87f-41ae-8c67-394ae60f9852 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.086566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e606d7-b87f-41ae-8c67-394ae60f9852 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.086979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e606d7-b87f-41ae-8c67-394ae60f9852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.143040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 859/1756] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:34.147961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b3e606d7-b87f-41ae-8c67-394ae60f9852 None None] MFA Rules not processed for user `41ce0f525e794b78a8117dd2937d20a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:34.149942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b3e606d7-b87f-41ae-8c67-394ae60f9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:34.229290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.232236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.233029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.237023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 860/1757] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:28:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:28:34.259884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:34.261700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:34.369301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 898/1758] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:34.370800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.373138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.375335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.404269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:34.450071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:34.451665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:34.465331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0353a-6f66-404b-a3fc-12e033213791 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:34.481197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:34.485165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.486257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.489579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.523636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:34.526922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:34.565761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 861/1759] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:34.569127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:34.575772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:34.707206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 899/1760] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:34.789718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637644c1-a85d-4828-b893-249a62c8e056 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:34.815663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:34.818422 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:34.818553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:34.820662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:34.856107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:34.859930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:34.898412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:34.914037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 862/1761] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:35.851931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:35.855816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:35.891107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f0200-e28e-46d0-bf40-a7ab2086f313 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:35.906214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:35.908968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:35.910624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:35.911606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:35.943381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:35.947999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:35.986958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 900/1762] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:36.090578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:36.105560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4442d-043e-4f79-bf24-29da41772e8e service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:36.117365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:36.119397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:36.119714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:36.120055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:36.128369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:36.317761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:36.324321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22803444-9c5d-4b2c-84b5-6589332b44eb service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:36.358769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 863/1763] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:36.508188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:36.509651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:36.912402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f2d96-5b11-4c14-b0e1-c01de8def665 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:36.927621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:36.932417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:36.936028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:36.937640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] PATH_INFO: `/v3/projects/bc2b2b6f71fd48cd97433c78259e6512` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:36.948542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2b2b6f71fd48cd97433c78259e6512)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:36.959865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:37.159610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2b2b6f71fd48cd97433c78259e6512', 'request_id': 'req-7c6a0602-2b7e-441d-a96e-6e87b892615e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:37.184084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2b2b6f71fd48cd97433c78259e6512', 'request_id': 'req-7c6a0602-2b7e-441d-a96e-6e87b892615e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:37.198942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2b2b6f71fd48cd97433c78259e6512', 'request_id': 'req-7c6a0602-2b7e-441d-a96e-6e87b892615e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:37.256021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] The token cache is being invalidate because project bc2b2b6f71fd48cd97433c78259e6512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:37.258131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:37.267970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7c6a0602-2b7e-441d-a96e-6e87b892615e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:37.277642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 901/1764] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:36 2022] DELETE /identity/v3/projects/bc2b2b6f71fd48cd97433c78259e6512 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:37.279927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae81f-b670-47a9-a741-913711002f3c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:37.280424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae81f-b670-47a9-a741-913711002f3c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:37.283961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae81f-b670-47a9-a741-913711002f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:37.322540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-134ae81f-b670-47a9-a741-913711002f3c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:37.327083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-134ae81f-b670-47a9-a741-913711002f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:37.532849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 864/1765] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:37.539634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:37.539929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:37.540210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:37.595694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:37.598423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:37.616182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 902/1766] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:37.620000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ae81f-b670-47a9-a741-913711002f3c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:37.635429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ae81f-b670-47a9-a741-913711002f3c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:37.644631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:37.645673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:37.649986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:37.649986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:37.649986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:37.649986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:37.654012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:37.673693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 865/1767] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:37.678225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:37.691445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176eb5-8929-4243-8c2c-dbeb3cb0edf2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:37.709587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:37.712199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:37.712199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:37.712414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:37.715656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:37.723035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:37.730366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:37.802644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 903/1768] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:37 2022] POST /identity/v3/projects => generated 357 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:37.805627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:37.828834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e03d6a-9cfe-4d98-89f2-f5260db0e734 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:38.027674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:38.032117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:38.032457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:38.032843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:38.035493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:38.048918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:38.108846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:38.137568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 866/1769] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:37 2022] POST /identity/v3/users => generated 279 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:38.144515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4f65-6ac9-44f2-b0fb-e7343ab4ed0c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:38.159246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:38.161601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:38.162117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:38.164529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:38.165697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:38.170422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:38.210068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:38.222160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 904/1770] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:38.229557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357e5ba-d33d-4f0c-b102-858e0543def6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:38.244372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:38.245340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:38.245576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:38.246748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:38.246924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:38.250534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783bc82-cf3e-4504-b259-9f870224d1f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:38.278934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 867/1771] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:38.284022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:38.305654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50043a78-b010-4bd1-8ecd-efbac5b7322f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:38.319816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:38.322364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:38.323165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:38.325227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] PATH_INFO: `/v3/projects/3f0e9e5c3320458a9dd24ab66b9cb028/users/da9ffabb0e584e189f5187085ef1984b/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:38.380268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0e9e5c3320458a9dd24ab66b9cb028, user_id=da9ffabb0e584e189f5187085ef1984b, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:38.389755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:38.483791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 905/1772] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:38 2022] PUT /identity/v3/projects/3f0e9e5c3320458a9dd24ab66b9cb028/users/da9ffabb0e584e189f5187085ef1984b/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:38.491597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:38.492000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:38.492242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:38.531756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:38.624245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] MFA Rules not processed for user `da9ffabb0e584e189f5187085ef1984b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:38.627230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:38.869614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 868/1773] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:38.874512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:39.130618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fc519-994d-4d02-8765-f5c230bf19d5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:39.151396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:39.157623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:39.157949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:39.158302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:39.159063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:39.162577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d579bb-6370-47ac-bec9-dca7380fb128 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:39.257773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 906/1774] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:38 2022] POST /identity/v3/projects => generated 355 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:39.261617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:39.277179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdbcd-62a6-4719-9dc0-563848b722f7 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:39.406278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:39.406649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:39.406954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:39.454723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] MFA Rules not processed for user `4d86a6b64c22467d9852238e50122b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:39.456027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:39.469788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:39.470540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:39.470822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:39.471156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:39.471918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:39.474022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:39.515911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 869/1775] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:39 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:39.520468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:39.544985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae0196-72b0-4862-829a-aefbc6fd83d7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:39.570083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:39.572902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:39.574144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:39.575630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:39.580656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:39.586363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:39.621837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 907/1776] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:39.661571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 870/1777] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:39.666469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:39.688929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6b43-b440-43d0-b8c3-0e757e30d803 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:39.710787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:39.713547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:39.717396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:39.717964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] PATH_INFO: `/v3/projects/19130bf42e48441ebbd0956d9592eba8/users/7eabedab0a0446248563d3bf09b90d4f/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:39.772552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19130bf42e48441ebbd0956d9592eba8, user_id=7eabedab0a0446248563d3bf09b90d4f, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:39.798900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:39.855486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 908/1778] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:39 2022] PUT /identity/v3/projects/19130bf42e48441ebbd0956d9592eba8/users/7eabedab0a0446248563d3bf09b90d4f/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:39.859238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:39.873317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfb8d3-0633-45c3-9148-b2b6d1e2d7b5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:40.061794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:40.067536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.069511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.069945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.070887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:40.075432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb8945-1d2b-4c06-be87-aa210d10367b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:40.104634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 871/1779] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:40.106186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:40.124559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a54fb-8ca2-4115-8315-a766d2785b9e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:40.143325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:40.149585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.150266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.162573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] PATH_INFO: `/v3/projects/19130bf42e48441ebbd0956d9592eba8/users/7eabedab0a0446248563d3bf09b90d4f/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.169393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=19130bf42e48441ebbd0956d9592eba8, user_id=7eabedab0a0446248563d3bf09b90d4f, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:40.184532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:40.223497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 909/1780] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:40 2022] PUT /identity/v3/projects/19130bf42e48441ebbd0956d9592eba8/users/7eabedab0a0446248563d3bf09b90d4f/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:40.241352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.242707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.243281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.318085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:40.350801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] MFA Rules not processed for user `7eabedab0a0446248563d3bf09b90d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:40.352201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:40.411540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:40.413631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:40.422166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:40.579144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 872/1781] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:40.595062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:40.597045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:40.598726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238fdeb-7d00-43f0-b1c2-06552bca51bd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:40.616101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:40.617356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.618449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.620385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] PATH_INFO: `/v3/users/f6d094a2b066416abb1ca20ab85edf6e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.624941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d094a2b066416abb1ca20ab85edf6e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:40.629008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:40.720193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476c6e0-53d9-4632-ac3a-49240e300928 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:40.726413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:40.727288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.727841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.728386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.746561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d094a2b066416abb1ca20ab85edf6e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:40.756810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:40.759699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7140288-d66a-4cdf-9415-940124efb3a6 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:40.777794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 873/1782] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:40.780051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d094a2b066416abb1ca20ab85edf6e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:40.790846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d094a2b066416abb1ca20ab85edf6e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:40.791809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d094a2b066416abb1ca20ab85edf6e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:40.804075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d094a2b066416abb1ca20ab85edf6e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:40.817809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 910/1783] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:40 2022] DELETE /identity/v3/users/f6d094a2b066416abb1ca20ab85edf6e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:40.823132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:40.823669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:40.824048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:40.881137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:40.882639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:40.926234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:40.933893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:41.015416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 874/1784] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:41.074010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:41.075602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:41.093859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f5de-7281-45b4-bc71-5e1a07327d69 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:41.106111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10632231-915d-457f-900c-c0a074630424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:41.108814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632231-915d-457f-900c-c0a074630424 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:41.109203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632231-915d-457f-900c-c0a074630424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:41.110448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10632231-915d-457f-900c-c0a074630424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:41.115830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-10632231-915d-457f-900c-c0a074630424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:41.157910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:41.189859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4556e-b858-4227-85a1-beeb82eee6c2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:41.199876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:41.200998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:41.201281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:41.201561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:41.210656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:41.227963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:41.232529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:41.256922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 875/1785] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:41.262998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10632231-915d-457f-900c-c0a074630424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:41.265325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10632231-915d-457f-900c-c0a074630424 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:41.289463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 911/1786] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:41.654309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:41.655996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:41.681310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e8cc-e111-4c18-8160-7bd316d90904 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:41.688021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:41.688963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:41.689443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:41.689726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] PATH_INFO: `/v3/users/cbfd2926264442268960ddb9ca47a4fd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:41.692892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfd2926264442268960ddb9ca47a4fd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:41.694896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:41.815023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfd2926264442268960ddb9ca47a4fd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:41.829132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfd2926264442268960ddb9ca47a4fd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:41.846700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfd2926264442268960ddb9ca47a4fd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:41.847467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfd2926264442268960ddb9ca47a4fd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:41.857499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfd2926264442268960ddb9ca47a4fd'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:41.867651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 876/1787] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:41 2022] DELETE /identity/v3/users/cbfd2926264442268960ddb9ca47a4fd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:41.872305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:41.872625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:41.872900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:41.906171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:41.906286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:41.938652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:41.940771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:42.034032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 912/1788] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:42.040163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:42.042327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:42.048265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3133b6-6fbc-43a7-b270-524f386e9b06 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:42.055130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:42.057091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:42.057643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:42.058076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] PATH_INFO: `/v3/projects/399385f78bb1459baec798bc0c23c2be` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:42.060165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399385f78bb1459baec798bc0c23c2be)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:42.062987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:42.129581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055be19-9c21-425f-b3ad-58a348586f48 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:42.131742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399385f78bb1459baec798bc0c23c2be', 'request_id': 'req-82b5cee5-f6f0-4ce1-9cb3-188382d92255'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.136837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:42.144061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399385f78bb1459baec798bc0c23c2be', 'request_id': 'req-82b5cee5-f6f0-4ce1-9cb3-188382d92255'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.155393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399385f78bb1459baec798bc0c23c2be', 'request_id': 'req-82b5cee5-f6f0-4ce1-9cb3-188382d92255'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.171107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] The token cache is being invalidate because project 399385f78bb1459baec798bc0c23c2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:42.171434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.172293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.174612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 877/1789] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:41 2022] DELETE /identity/v3/projects/399385f78bb1459baec798bc0c23c2be => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:42.178616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:42.180034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:42.215297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:42.216163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:42.216341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:42.216630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:42.218663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:42.302651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5cee5-f6f0-4ce1-9cb3-188382d92255 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:42.320504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:42.321466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:42.321756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:42.322035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] PATH_INFO: `/v3/users/41ce0f525e794b78a8117dd2937d20a0` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:42.324408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ce0f525e794b78a8117dd2937d20a0)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:42.326408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:42.335784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:42.374062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:42.375786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:42.388095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 913/1790] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:42.419979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ce0f525e794b78a8117dd2937d20a0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.428428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ce0f525e794b78a8117dd2937d20a0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.444291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ce0f525e794b78a8117dd2937d20a0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.445052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ce0f525e794b78a8117dd2937d20a0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.453826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ce0f525e794b78a8117dd2937d20a0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.466343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 878/1791] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:42 2022] DELETE /identity/v3/users/41ce0f525e794b78a8117dd2937d20a0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:42.787384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:42.808189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc830a44-b42f-45ab-9a85-b161ceb4ebf3 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:42.897980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:42.900584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:42.900874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:42.901154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] PATH_INFO: `/v3/projects/d1d2cbf7ab294712b0b962b795f19a08` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:42.902715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d2cbf7ab294712b0b962b795f19a08)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:42.906505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:42.919690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:42.921150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:42.943586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d04be4-2f69-4145-92ed-85c3c7db848b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:42.960804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:42.962289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:42.962631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:42.962936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] PATH_INFO: `/v3/projects/e291826ca2034fca9e10829f80434a45` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:42.964650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e291826ca2034fca9e10829f80434a45)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:42.966599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:42.988320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d2cbf7ab294712b0b962b795f19a08', 'request_id': 'req-a72359bd-6e50-4dd6-a229-ce93fc959a1e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:42.999784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d2cbf7ab294712b0b962b795f19a08', 'request_id': 'req-a72359bd-6e50-4dd6-a229-ce93fc959a1e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.009682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d2cbf7ab294712b0b962b795f19a08', 'request_id': 'req-a72359bd-6e50-4dd6-a229-ce93fc959a1e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.036982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] The token cache is being invalidate because project d1d2cbf7ab294712b0b962b795f19a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:43.037287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.038578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a72359bd-6e50-4dd6-a229-ce93fc959a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.047182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 914/1792] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:42 2022] DELETE /identity/v3/projects/d1d2cbf7ab294712b0b962b795f19a08 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:43.051872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c11-5a3d-4f20-a01f-8857bde8c1d5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.052163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c11-5a3d-4f20-a01f-8857bde8c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.052455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d51c11-5a3d-4f20-a01f-8857bde8c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.060369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e291826ca2034fca9e10829f80434a45', 'request_id': 'req-fcaa8586-e104-4efd-afa0-b75873848ed0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.072389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e291826ca2034fca9e10829f80434a45', 'request_id': 'req-fcaa8586-e104-4efd-afa0-b75873848ed0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.075340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:43.077690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-13d51c11-5a3d-4f20-a01f-8857bde8c1d5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:43.078988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-13d51c11-5a3d-4f20-a01f-8857bde8c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:43.083394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e291826ca2034fca9e10829f80434a45', 'request_id': 'req-fcaa8586-e104-4efd-afa0-b75873848ed0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.125772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] The token cache is being invalidate because project e291826ca2034fca9e10829f80434a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:43.126075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.130059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.138208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 879/1793] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:42 2022] DELETE /identity/v3/projects/e291826ca2034fca9e10829f80434a45 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:43.139703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.142055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:43.232044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 915/1794] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:43.248866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.249240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.249714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.283314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:43.284870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:43.294835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa8586-e104-4efd-afa0-b75873848ed0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.297661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 916/1795] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:43.300417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.301510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.303779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.304222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.304659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] PATH_INFO: `/v3/users/85f4203bd32e479a8523d495f9335a83` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.306166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f4203bd32e479a8523d495f9335a83)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.309142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.314276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351ab55-c4a6-4359-bbeb-592eee9957b6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.319417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.320342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.321520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.321896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.322977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:43.323435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.325268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.327145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:43.353877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 917/1796] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:43.357620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.373242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6ec-7962-49fc-85e0-2852d8c02d27 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.378738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.379569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.379739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.380216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.381001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.383001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.398259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f4203bd32e479a8523d495f9335a83'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.409146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f4203bd32e479a8523d495f9335a83'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.417155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 918/1797] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:43.421391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.427902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f4203bd32e479a8523d495f9335a83'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.428812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f4203bd32e479a8523d495f9335a83'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.441213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f4203bd32e479a8523d495f9335a83'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:43.452278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 880/1798] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:43 2022] DELETE /identity/v3/users/85f4203bd32e479a8523d495f9335a83 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:43.535215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22283b-fff3-475e-a36e-83ac36b76add admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.641820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.646793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.647149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.647566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.651891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.654077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.683120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 919/1799] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:43 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:43.683570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.685077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:43.707756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7b35-1ab6-42a8-90fa-3e7e7b2d9afe admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.717968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.719113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.720695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.721060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.721830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.728108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.750669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 881/1800] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:43.755125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.768945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395395b-d038-4bdf-a2e1-bf5deab86eec admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.778421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.781602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.782169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.782698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.785782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.788833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0639a-d5f4-4181-9ada-7167ca781b48 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.834030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 920/1801] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:43.843767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:43.857781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e56285-c8bd-4c7f-8af0-ca1e8e6ec923 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:43.863648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:43.865163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.865454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.865736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] PATH_INFO: `/v3/projects/ba52df844d9a47a2bfad58f17e56c3b6/users/b5e2083949904f32b9eadb685f848037/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.885742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba52df844d9a47a2bfad58f17e56c3b6, user_id=b5e2083949904f32b9eadb685f848037, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:43.888868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:43.908574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 882/1802] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:43 2022] PUT /identity/v3/projects/ba52df844d9a47a2bfad58f17e56c3b6/users/b5e2083949904f32b9eadb685f848037/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:43.920638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:43.920932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:43.921214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:43.956226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] MFA Rules not processed for user `b5e2083949904f32b9eadb685f848037`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:43.957614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.076049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:44.130757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 921/1803] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:44.140236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.232998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:44.317103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ae1b-a024-41ce-878f-9092f00a3d5a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.332330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:44.332844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.333134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.333418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.334173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:44.344277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:44.408373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 883/1804] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:44 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:44.409917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.426469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78283e9-81fe-41f5-8827-3604c6a5df70 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.579970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:44.580207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.580704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.581049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.581293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.582018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.582185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:44.584870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:44.606948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f4909-f01b-4d9d-be27-1964befe3860 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.619024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 922/1805] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:44 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:44.623094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.624739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:44.625812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.626123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.626404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] PATH_INFO: `/v3/projects/4c0af137a5b841ddb638d02fc5273d61` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.628929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0af137a5b841ddb638d02fc5273d61)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:44.631073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:44.644794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05719e-38bd-4ec2-9c4c-813a22ad0338 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.657151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:44.657976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.658350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.659175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.660103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:44.661944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9095f37-abc9-4dad-a6c3-04527071fcc0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:44.689423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 923/1806] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:44.693463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b124-c3c6-4010-b155-83e3fac50192 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.693776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b124-c3c6-4010-b155-83e3fac50192 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.694097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b124-c3c6-4010-b155-83e3fac50192 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.700522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 924/1807] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:28:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:44.701430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91b124-c3c6-4010-b155-83e3fac50192 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.716335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0af137a5b841ddb638d02fc5273d61', 'request_id': 'req-5256b7df-9504-4ca7-9b75-1243c44ab94d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:44.728486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0af137a5b841ddb638d02fc5273d61', 'request_id': 'req-5256b7df-9504-4ca7-9b75-1243c44ab94d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:44.737882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0af137a5b841ddb638d02fc5273d61', 'request_id': 'req-5256b7df-9504-4ca7-9b75-1243c44ab94d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:44.758847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] The token cache is being invalidate because project 4c0af137a5b841ddb638d02fc5273d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:44.759166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:44.760016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5256b7df-9504-4ca7-9b75-1243c44ab94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:44.761813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 884/1808] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:44 2022] DELETE /identity/v3/projects/4c0af137a5b841ddb638d02fc5273d61 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:44.765056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.765056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.765056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.784061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:44.785321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.794482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91b124-c3c6-4010-b155-83e3fac50192 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.803009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:44.804015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.804426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.805233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] PATH_INFO: `/v3/projects/d7bba13706e147e9872c7c61b133d1c4/users/793ac4a460c447caa0e0a786a1806d76/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.829564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bba13706e147e9872c7c61b133d1c4, user_id=793ac4a460c447caa0e0a786a1806d76, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:44.833014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a118a-3f4d-4c90-8d70-ec8c51873cbb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:44.854936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 925/1809] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:44 2022] PUT /identity/v3/projects/d7bba13706e147e9872c7c61b133d1c4/users/793ac4a460c447caa0e0a786a1806d76/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:44.858056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121bac-7220-448c-baf8-cf755602562b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:44.858056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121bac-7220-448c-baf8-cf755602562b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:44.858056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62121bac-7220-448c-baf8-cf755602562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:44.890042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 885/1810] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:44.890925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.892418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.903863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-62121bac-7220-448c-baf8-cf755602562b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:44.911193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-62121bac-7220-448c-baf8-cf755602562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.911282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784a8c3-1656-42e0-adba-22878f80081f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:44.944793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:44.970340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:44.988637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 926/1811] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:44.989701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121bac-7220-448c-baf8-cf755602562b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:44.991066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-62121bac-7220-448c-baf8-cf755602562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:44.999479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.000159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.000810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.000922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.001680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.003433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53787e16-afcc-4421-a9db-0ce525032aa9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.014512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 886/1812] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:45.016015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.016390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.016649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.040770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:45.041926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:45.050824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 887/1813] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:45.051479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.065404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9888c9-6ba2-450a-8efa-e6a5151fae0f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.071327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.072246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.072559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.072838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] PATH_INFO: `/v3/projects/d7bba13706e147e9872c7c61b133d1c4/users/793ac4a460c447caa0e0a786a1806d76/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.074878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bba13706e147e9872c7c61b133d1c4, user_id=793ac4a460c447caa0e0a786a1806d76, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.077625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.081171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62121bac-7220-448c-baf8-cf755602562b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.087180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.087804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.088092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.088376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.088733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 888/1814] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:45 2022] PUT /identity/v3/projects/d7bba13706e147e9872c7c61b133d1c4/users/793ac4a460c447caa0e0a786a1806d76/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:45.089630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.105164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.106867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa6cf-be5f-42bb-b207-ee496cd37f0b service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.118326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 927/1815] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:45.119648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.119940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.120224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.150550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] MFA Rules not processed for user `793ac4a460c447caa0e0a786a1806d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:45.151865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:45.164718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a6ebd-335a-4303-a045-e913c7885ec6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.169566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.170237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.170522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.170795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.171564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:45.171870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.173543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.186485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 889/1816] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:45.191108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.202740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf0b18-24e1-4d3f-b7f0-dd324836fede admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.207560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.208262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.208557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.208851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.209807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.212102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.236368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 928/1817] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:45.249768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.251246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:45.255570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 890/1818] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:28:45.258519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.325516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f77f-5e22-45c2-86ea-c40c117ef99f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.338802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d4501-0853-4e51-a92b-5aec8b89cf7e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.339910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:45.344668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.345379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.345714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.345997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.346693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.349094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.377702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 891/1819] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:45.381283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.381797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.382182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.382490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.382769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.384609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:45.393959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe8a95-914b-4e83-8619-8c8986d2a57d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.400561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.401231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.401533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.401798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.402532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.404185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.405802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:45.417939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 892/1820] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:45.421098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.432000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767aee-f43d-4cdf-8f9c-fe48056a027f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.437049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.437780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.438067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.438345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.439103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.440906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.455420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 893/1821] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:45.459520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.461057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.462774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb46bf-3618-4a23-9b82-d45c1c73279c service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.472556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 929/1822] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:45.481348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df1a22-2f81-48ca-8ce7-63ca7a580bca admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.486337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.487265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.487580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.487857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] PATH_INFO: `/v3/projects/7db653ee16ec4c109c51e480a8506325/users/e7f78531cb7e428fbcb2bd146ac8721e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.504198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db653ee16ec4c109c51e480a8506325, user_id=e7f78531cb7e428fbcb2bd146ac8721e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.507766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.538952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 894/1823] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:45 2022] PUT /identity/v3/projects/7db653ee16ec4c109c51e480a8506325/users/e7f78531cb7e428fbcb2bd146ac8721e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:45.552052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.552710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.553207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.603825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] MFA Rules not processed for user `e7f78531cb7e428fbcb2bd146ac8721e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:45.605311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:45.733690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 930/1824] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:45.737913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.831934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f1b26-3a2a-4988-8737-b8d8af0bfa72 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:45.838518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:45.839338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:45.839776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:45.840190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:45.840919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:45.843020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:45.875124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 895/1825] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:45.879424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:45.899532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464d6c2-7196-48fc-be19-be970e58494b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.016798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.017809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.018130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.018367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.019090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.021033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.030756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:46.047232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 931/1826] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:45 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:46.051667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.063065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff61e82-4e63-4c98-8476-29c470ca0b02 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.068239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.068896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.069364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.069720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.070537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.072602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.086841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 896/1827] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:46.091015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.105166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f020ca-a975-4ef9-a0d4-611668185b72 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.110808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.111980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.112139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.112414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] PATH_INFO: `/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414/users/27d97a0630a543a3aed949e5edf04d69/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.137485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb339a1218a4c25ae0cbca82a9e4414, user_id=27d97a0630a543a3aed949e5edf04d69, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.140345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.155934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 932/1828] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:46 2022] PUT /identity/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414/users/27d97a0630a543a3aed949e5edf04d69/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:46.160014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.170749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd890eec-1b2b-4952-b062-19a31ca254ad admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.229481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.230165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.230451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.230729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.231494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.233105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b208255-f523-4ec9-8d12-cbb047ae6c47 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.243454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 897/1829] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:46.249320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.265306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a6833-0df1-4e2c-b43d-d1114bde8071 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.270693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.271677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.272515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.272972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] PATH_INFO: `/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414/users/27d97a0630a543a3aed949e5edf04d69/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.275120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb339a1218a4c25ae0cbca82a9e4414, user_id=27d97a0630a543a3aed949e5edf04d69, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.277777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.288348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 933/1830] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:46 2022] PUT /identity/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414/users/27d97a0630a543a3aed949e5edf04d69/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:46.300020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.300314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.300594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.327439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] MFA Rules not processed for user `27d97a0630a543a3aed949e5edf04d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:46.328662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.348740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:46.385636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.387428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.411128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 898/1831] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:46.420043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.421589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.468232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d0925-4ba7-440b-b6b6-ac7a86008b4d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.474053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.475060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.475351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.475659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] PATH_INFO: `/v3/users/a1400684bf594731ad931e85ea5f0b48` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.476971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1400684bf594731ad931e85ea5f0b48)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.478913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.483155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21a03-3130-48e5-a79b-5465c9f0b942 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.487053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.487735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.488016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.488360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.499750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.501204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0a6ed-96a2-4fda-a20d-86d77cbb402a service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.511776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 899/1832] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:46.532968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1400684bf594731ad931e85ea5f0b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:46.547152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1400684bf594731ad931e85ea5f0b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:46.554798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1400684bf594731ad931e85ea5f0b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:46.555551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1400684bf594731ad931e85ea5f0b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:46.568950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1400684bf594731ad931e85ea5f0b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:46.578855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 934/1833] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:46 2022] DELETE /identity/v3/users/a1400684bf594731ad931e85ea5f0b48 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:46.584641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.585341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.585786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.610288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:46.611633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.619297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.620980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.665313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:46.679135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 900/1834] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:46.689496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:46.690875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.698977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a8467-bef4-48e8-bce1-037879a34e5b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.702779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.703468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.703878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.704162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.706129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:46.762949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca1807-60b5-45f3-ac8c-a7af6c470b92 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:46.774521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:46.774521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:46.774521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:46.774521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:46.774892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.774983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.778565 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:46.780044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:46.784111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 935/1835] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:46.790038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 901/1836] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:47.390253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:47.392873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:47.424588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a175ad-d3c8-4536-a81b-5f2ee9e40668 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:47.438466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:47.439290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:47.439601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:47.439881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] PATH_INFO: `/v3/users/e7f78531cb7e428fbcb2bd146ac8721e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:47.441115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f78531cb7e428fbcb2bd146ac8721e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:47.444196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:47.612455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:47.614159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:47.627496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:47.629559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f78531cb7e428fbcb2bd146ac8721e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.655732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286df788-1e76-4abf-a215-63858846b3de service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:47.679764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:47.681244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:47.681330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f78531cb7e428fbcb2bd146ac8721e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.681499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:47.684381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] PATH_INFO: `/v3/projects/8b98bab18a1246f6bd541ce612ba9582` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:47.688410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b98bab18a1246f6bd541ce612ba9582)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:47.695700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:47.699910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f78531cb7e428fbcb2bd146ac8721e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.709420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f78531cb7e428fbcb2bd146ac8721e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.723696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-767bf671-b1de-43c9-a841-fd3b13e5cb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f78531cb7e428fbcb2bd146ac8721e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.732909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 936/1837] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:47 2022] DELETE /identity/v3/users/e7f78531cb7e428fbcb2bd146ac8721e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:47.737927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:47.738729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:47.739306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:47.788057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:47.791421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:47.828435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b98bab18a1246f6bd541ce612ba9582', 'request_id': 'req-5f3a80ef-f813-41a3-92da-d76fb18208fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.856612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b98bab18a1246f6bd541ce612ba9582', 'request_id': 'req-5f3a80ef-f813-41a3-92da-d76fb18208fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.875826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b98bab18a1246f6bd541ce612ba9582', 'request_id': 'req-5f3a80ef-f813-41a3-92da-d76fb18208fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.900214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] The token cache is being invalidate because project 8b98bab18a1246f6bd541ce612ba9582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:47.900725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.901607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:47.906344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 902/1838] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:47 2022] DELETE /identity/v3/projects/8b98bab18a1246f6bd541ce612ba9582 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:47.907450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:47.908934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:47.950036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:47.978327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 937/1839] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:48.028124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a80ef-f813-41a3-92da-d76fb18208fb admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:48.029994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:48.033163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:48.044763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:48.045750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:48.046034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:48.048922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] PATH_INFO: `/v3/users/b4ccac9f41d449ca84a43974fe3e3deb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:48.051471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ccac9f41d449ca84a43974fe3e3deb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:48.073416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:48.194286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ccac9f41d449ca84a43974fe3e3deb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:48.216608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ccac9f41d449ca84a43974fe3e3deb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:48.234524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb884-a7c3-49ae-8138-527b5b1ba6d5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:48.244322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:48.247332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:48.248485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:48.249838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:48.254801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ccac9f41d449ca84a43974fe3e3deb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:48.257494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ccac9f41d449ca84a43974fe3e3deb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:48.283607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:48.283607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:48.287157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ccac9f41d449ca84a43974fe3e3deb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:48.296862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 903/1840] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:47 2022] DELETE /identity/v3/users/b4ccac9f41d449ca84a43974fe3e3deb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:48.303660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 938/1841] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:49.084895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.088340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:49.098175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.112149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d997bd-241a-4bfc-a5cf-67e77ad52f86 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.115392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:49.247860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.249377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.250700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.251182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] PATH_INFO: `/v3/projects/acd3f98286214b2094f415d37bfe0a77` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.252728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd3f98286214b2094f415d37bfe0a77)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.253979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b831b1-83d9-4c82-8ca0-fbc78a929228 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.257483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:49.276137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.277361 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.277671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.277956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] PATH_INFO: `/v3/projects/7db653ee16ec4c109c51e480a8506325` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.280464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db653ee16ec4c109c51e480a8506325)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.287915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:49.374726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd3f98286214b2094f415d37bfe0a77', 'request_id': 'req-0bf24b7f-1064-4d50-86bc-d0446e88f690'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.380624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db653ee16ec4c109c51e480a8506325', 'request_id': 'req-b70afd01-322b-475d-905d-bff9ccda7029'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.394009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db653ee16ec4c109c51e480a8506325', 'request_id': 'req-b70afd01-322b-475d-905d-bff9ccda7029'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.404564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd3f98286214b2094f415d37bfe0a77', 'request_id': 'req-0bf24b7f-1064-4d50-86bc-d0446e88f690'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.421193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd3f98286214b2094f415d37bfe0a77', 'request_id': 'req-0bf24b7f-1064-4d50-86bc-d0446e88f690'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.426959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db653ee16ec4c109c51e480a8506325', 'request_id': 'req-b70afd01-322b-475d-905d-bff9ccda7029'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.436061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] The token cache is being invalidate because project acd3f98286214b2094f415d37bfe0a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:49.436347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.437109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0bf24b7f-1064-4d50-86bc-d0446e88f690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.439030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 939/1842] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:49 2022] DELETE /identity/v3/projects/acd3f98286214b2094f415d37bfe0a77 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:49.441477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] The token cache is being invalidate because project 7db653ee16ec4c109c51e480a8506325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:49.442560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.443409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.445652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 904/1843] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:49 2022] DELETE /identity/v3/projects/7db653ee16ec4c109c51e480a8506325 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:49.446485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc2f0-fbfb-46ae-a57b-832a84ccfd20 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.447269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc2f0-fbfb-46ae-a57b-832a84ccfd20 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.447521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc2f0-fbfb-46ae-a57b-832a84ccfd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.449348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.455108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:49.470874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2e9fc2f0-fbfb-46ae-a57b-832a84ccfd20 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:49.472058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2e9fc2f0-fbfb-46ae-a57b-832a84ccfd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:49.506642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:49.550991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 940/1844] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:49.553597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70afd01-322b-475d-905d-bff9ccda7029 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.560759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.561140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.561325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.564460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.568156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.570218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.570512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] PATH_INFO: `/v3/users/27d97a0630a543a3aed949e5edf04d69` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.571886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d97a0630a543a3aed949e5edf04d69)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.574013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:49.608328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:49.609636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:49.630261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 941/1845] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:49.631614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.634301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:49.646602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976f643-5353-4179-aa08-f6341d3f829a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.650370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d97a0630a543a3aed949e5edf04d69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.652449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.653330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.653737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.654094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.654994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:49.655548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.657739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:49.660610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d97a0630a543a3aed949e5edf04d69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.675427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 942/1846] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:49.680572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.681808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d97a0630a543a3aed949e5edf04d69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.682714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d97a0630a543a3aed949e5edf04d69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.691416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e985c25-c581-4cea-a678-1d0796bb7380 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.692954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d97a0630a543a3aed949e5edf04d69'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:49.697887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.698566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.698919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.699199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.699928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.701812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:49.706795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 905/1847] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:49 2022] DELETE /identity/v3/users/27d97a0630a543a3aed949e5edf04d69 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:49.736438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 943/1848] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:49 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:28:49.741198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:49.742948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:49.870552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29931d-5a14-4343-b5f2-a1a56b14e4a1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:49.964012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:49.964901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:49.965146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:49.965471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:49.966195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:49.969039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.002455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 906/1849] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:49 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:28:50.007186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.022369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7c79-8544-47da-9dc2-96373c88d43f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.039100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.040073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.040503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.041013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.041935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.044173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.070464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 944/1850] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:50.071285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.086695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4ead0-604d-43ce-b4af-07524802f125 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.093885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.094723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.095110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.095508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.096324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.098934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.115153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 907/1851] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:50.116769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.138029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133aeef1-15f0-4dd6-a63d-5e600818146f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.143999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.145988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.148619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.149492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] PATH_INFO: `/v3/projects/2190cde267f946afa3cc9ab6c67c2ad4/users/b155db4426b74530a454b9b12ecaff24/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.174934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.175943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2190cde267f946afa3cc9ab6c67c2ad4, user_id=b155db4426b74530a454b9b12ecaff24, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.176976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.181482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49812162-dd5b-42fb-bd00-5e42b9c089e2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.206214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b14ce-bf61-4250-93cc-0dc60ca32799 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.208379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 945/1852] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:50 2022] PUT /identity/v3/projects/2190cde267f946afa3cc9ab6c67c2ad4/users/b155db4426b74530a454b9b12ecaff24/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:50.218341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.218644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.218920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.260373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] MFA Rules not processed for user `b155db4426b74530a454b9b12ecaff24`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:50.261849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.274796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:50.323505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.324846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.325136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.325414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] PATH_INFO: `/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.327446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb339a1218a4c25ae0cbca82a9e4414)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.329419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.385704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 946/1853] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:50.390972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.405416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a02620-6ff6-4426-9fac-bd2b8b18f63d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.411007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.411780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.412069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.412350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.413122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.415098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.439269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb339a1218a4c25ae0cbca82a9e4414', 'request_id': 'req-47889860-fa7b-412e-a2f4-712f81825c94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:50.452779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb339a1218a4c25ae0cbca82a9e4414', 'request_id': 'req-47889860-fa7b-412e-a2f4-712f81825c94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:50.455727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 947/1854] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:50.460440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.460595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb339a1218a4c25ae0cbca82a9e4414', 'request_id': 'req-47889860-fa7b-412e-a2f4-712f81825c94'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:50.476064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] The token cache is being invalidate because project fdb339a1218a4c25ae0cbca82a9e4414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:50.476353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:50.477098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-47889860-fa7b-412e-a2f4-712f81825c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:50.478712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 908/1855] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:50 2022] DELETE /identity/v3/projects/fdb339a1218a4c25ae0cbca82a9e4414 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:50.483341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02ef9-f1a9-40df-9800-5f2595c1a898 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.483757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02ef9-f1a9-40df-9800-5f2595c1a898 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.484041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02ef9-f1a9-40df-9800-5f2595c1a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.492513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:50.504493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-38f02ef9-f1a9-40df-9800-5f2595c1a898 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:50.505763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-38f02ef9-f1a9-40df-9800-5f2595c1a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.536375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d438c2-9aa0-4b13-a838-c8e2bc6db752 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.541256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.541988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.542275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.542553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.543242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.545459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.572335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 948/1856] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:50.576423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.577731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.583496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 909/1857] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:50.588881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.589176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.589458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.596721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1306b-1579-4810-bfcc-9e55f2362699 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.603169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.604032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.604369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.604857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.605668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.607541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.609333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:50.610909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.619523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 949/1858] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:50.622611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 910/1859] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:50.623811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.626031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.636566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72bdd-8297-4cbc-8f80-039c67d750f9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.641398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.642306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.642589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.643235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] PATH_INFO: `/v3/projects/94e826114baa4808af815a237496ea4e/users/06be3869a2cb4608b004b757e7cf536b/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.649253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cc94e-0def-4311-a3b7-28a09b6cce7e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.661354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e826114baa4808af815a237496ea4e, user_id=06be3869a2cb4608b004b757e7cf536b, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.663500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.664328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.671215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.685705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 911/1860] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:28:50.689920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 950/1861] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:50 2022] PUT /identity/v3/projects/94e826114baa4808af815a237496ea4e/users/06be3869a2cb4608b004b757e7cf536b/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:50.690406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.693794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.701414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7efeb-62a3-4b3a-a372-2a18084a4308 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.755280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:50.766206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037433d-7857-43d0-9160-cbdb0783ffce admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.768553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.769362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.769622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.769907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.770670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.772728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.775197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.775933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.776225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.776636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.777276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.778875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.791026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 951/1862] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:50.795673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.806417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3239ab1-aec5-403e-ae3a-fc604a2eeee2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:50.809630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 912/1863] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:50.813952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:50.814417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:50.815329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.815640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.816690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] PATH_INFO: `/v3/projects/94e826114baa4808af815a237496ea4e/users/06be3869a2cb4608b004b757e7cf536b/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.824107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e826114baa4808af815a237496ea4e, user_id=06be3869a2cb4608b004b757e7cf536b, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:50.826912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4a83c-050a-4a0f-8861-8d1fd923b4c1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:50.840426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 952/1864] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:50 2022] PUT /identity/v3/projects/94e826114baa4808af815a237496ea4e/users/06be3869a2cb4608b004b757e7cf536b/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:50.852192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:50.852526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:50.852723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:50.905730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] MFA Rules not processed for user `06be3869a2cb4608b004b757e7cf536b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:50.907260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:50.910497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e3722-8b4f-4e37-b0ea-4d2f6d0190da admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.004629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:51.012767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.014044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.014431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.014900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.017217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.019959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.044891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 953/1865] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:51.044891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.047514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.048527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 913/1866] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:50 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:51.053333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.066025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f858-c08e-45cc-9af7-c39f9674a967 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.073494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.074755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.075145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.075598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.076621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.078332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.098820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 914/1867] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:28:51.100376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.102352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.129660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8441a-d2d6-449b-b656-c42f5b19806a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.134568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.135311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.135754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.136224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.138282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.165247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcfd28-c120-453c-9f9c-035ff40e8bfc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.169205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.169873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.170141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.170447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.179837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.181423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.191625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 915/1868] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:51.192449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.198473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:51.203284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9aed2-12ed-40c7-a6ba-5fc45c8b4251 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.210054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.210574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.210706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.210989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.211267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.212308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.212433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.214085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.224273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 954/1869] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:51.225086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 916/1870] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:51.229308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.241575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69803a34-830e-4a91-9ea4-c461a5ab1e2e service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.245773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.248136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.249035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.249320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.249597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] PATH_INFO: `/v3/projects/960812e1828d4a9cb91585ea8f6802a1/users/cc97a6a0bcb84e4fb5513d5891d805b5/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.256230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7572-d50c-4e85-8a1c-4297d27c89be admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.260112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.260834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.261191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.261538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.263533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.265752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960812e1828d4a9cb91585ea8f6802a1, user_id=cc97a6a0bcb84e4fb5513d5891d805b5, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.268569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ce992-54ef-43aa-a355-e254e0265006 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.284879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 955/1871] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:51 2022] PUT /identity/v3/projects/960812e1828d4a9cb91585ea8f6802a1/users/cc97a6a0bcb84e4fb5513d5891d805b5/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:51.289680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3268-60c2-4239-ab26-b0601576f1c6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.289976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3268-60c2-4239-ab26-b0601576f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.290260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b3268-60c2-4239-ab26-b0601576f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.328811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-533b3268-60c2-4239-ab26-b0601576f1c6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:51.330049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-533b3268-60c2-4239-ab26-b0601576f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.347457 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.349143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.360059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 917/1872] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:51.452920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 956/1873] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:51.464313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:51.466494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:51.574663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2923c-27cd-427d-b325-a9b9fb038318 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:51.676441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:51.678385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.678894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.680538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.697705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:51.701176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771321a-bf67-4f9f-a52b-961e2d1eaa6f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:51.726319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 918/1874] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:51.855075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.855661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.856263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.858246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 957/1875] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:28:51.886647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f1165-b5f9-4e03-a357-6c5f1bde900e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:51.886933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f1165-b5f9-4e03-a357-6c5f1bde900e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:51.887556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f1165-b5f9-4e03-a357-6c5f1bde900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:51.940177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-626f1165-b5f9-4e03-a357-6c5f1bde900e None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:51.945362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-626f1165-b5f9-4e03-a357-6c5f1bde900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:52.063285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:52.137490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 919/1876] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:52.150682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:52.152553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:52.180809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb16fa-18e5-4af4-823d-e3918e957fec None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:52.197878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:52.199021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:52.199493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:52.199907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:52.229023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:52.234876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:52.258927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:52.280877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 958/1877] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:53.275038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.275546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.275770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.315714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] MFA Rules not processed for user `cc97a6a0bcb84e4fb5513d5891d805b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:53.317231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:53.415763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 920/1878] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:53.428185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:53.441505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be473dd-dd73-4f3f-8568-ff1bdf89354e service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:53.448316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:53.449427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.449969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.450454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.451258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:53.453509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:53.500621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 959/1879] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:53.505488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:53.523429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3036b4-a65c-47ff-9701-ee46a87e4bb8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:53.624591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:53.625841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.626239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.627018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.627927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:53.630743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:53.696284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 921/1880] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:53 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:53.700135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:53.713899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2dc95-c73b-4846-bb01-e1f46514d9d2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:53.721315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:53.723075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.723571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.724057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.725872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:53.737595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:53.746995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 960/1881] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:53.747825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:53.764343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e84a88-3f07-459e-bed8-1fd132f59450 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:53.775849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:53.777925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.778213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.778487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] PATH_INFO: `/v3/projects/b1aca89227a643c2aba4f4b09c41bef7/users/4dac0d870a334acabaea8c856e689318/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.827258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aca89227a643c2aba4f4b09c41bef7, user_id=4dac0d870a334acabaea8c856e689318, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:53.836497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:53.867412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 922/1882] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:53 2022] PUT /identity/v3/projects/b1aca89227a643c2aba4f4b09c41bef7/users/4dac0d870a334acabaea8c856e689318/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:53.870155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:53.885649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aca56-3294-4aa5-b9d8-854c82223b55 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:53.969014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:53.971830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:53.972761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:53.973540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:53.975187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:53.978313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86469a-1def-444e-b12d-8a5c3ba10132 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:53.993423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 961/1883] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:53.997552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:54.009380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91e346-4633-459e-bd05-38012805b61f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:54.020260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:54.021372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:54.021734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:54.022706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] PATH_INFO: `/v3/projects/b1aca89227a643c2aba4f4b09c41bef7/users/4dac0d870a334acabaea8c856e689318/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:54.025515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aca89227a643c2aba4f4b09c41bef7, user_id=4dac0d870a334acabaea8c856e689318, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:54.029324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf61e-e804-4de0-b351-b370ef686295 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:54.043564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 923/1884] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:53 2022] PUT /identity/v3/projects/b1aca89227a643c2aba4f4b09c41bef7/users/4dac0d870a334acabaea8c856e689318/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:54.798968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:54.800464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:54.800918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:54.865079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] MFA Rules not processed for user `4dac0d870a334acabaea8c856e689318`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:54.869180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:54.995818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 962/1885] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:55.002789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:55.003664 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:55.003943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:55.030832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] MFA Rules not processed for user `cc97a6a0bcb84e4fb5513d5891d805b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:55.032351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:55.058483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:55.102329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 924/1886] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:55.113305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:55.169641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:55.199913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec638b4e-4488-4820-b576-6f714d691754 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:55.205386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:55.207243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:55.207243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:55.207243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:55.216237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:55.217835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2227b7f-aa34-4616-893a-7688dcf7b5b1 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:55.238095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 963/1887] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:55.714823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:55.848009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541276f6-a0ab-48c8-ae68-95c4f19db757 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:55.859985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:55.861377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:55.861779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:55.862137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] PATH_INFO: `/v3/users/b155db4426b74530a454b9b12ecaff24` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:55.863865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b155db4426b74530a454b9b12ecaff24)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:55.865814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:55.928974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b155db4426b74530a454b9b12ecaff24'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:55.940568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b155db4426b74530a454b9b12ecaff24'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:55.958795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b155db4426b74530a454b9b12ecaff24'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:55.959877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b155db4426b74530a454b9b12ecaff24'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:55.969122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b155db4426b74530a454b9b12ecaff24'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:55.978024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 925/1888] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:55 2022] DELETE /identity/v3/users/b155db4426b74530a454b9b12ecaff24 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:55.986482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:55.987082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:55.987082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:56.009240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:56.011027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:56.089043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 964/1889] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:56.098604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:56.100635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:56.166031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:56.171169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdafdea-ecb8-47a9-9edd-3cdc1ade4a98 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:56.176342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:56.177224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:56.178048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:56.178485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:56.196134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:56.197777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:56.210094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 926/1890] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:56.623291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:56.625000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:56.646642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386b49c-c384-41aa-9451-ec5f42393747 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:56.655424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:56.657542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:56.660390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:56.661067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] PATH_INFO: `/v3/projects/2190cde267f946afa3cc9ab6c67c2ad4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:56.663699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2190cde267f946afa3cc9ab6c67c2ad4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:56.667598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:56.753063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2190cde267f946afa3cc9ab6c67c2ad4', 'request_id': 'req-d09b2ed5-80df-43f6-91c7-00d0304caa4a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:56.760029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2190cde267f946afa3cc9ab6c67c2ad4', 'request_id': 'req-d09b2ed5-80df-43f6-91c7-00d0304caa4a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:56.770317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2190cde267f946afa3cc9ab6c67c2ad4', 'request_id': 'req-d09b2ed5-80df-43f6-91c7-00d0304caa4a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:56.793605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] The token cache is being invalidate because project 2190cde267f946afa3cc9ab6c67c2ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:56.794024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:56.794786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:56.799399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 965/1891] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:56 2022] DELETE /identity/v3/projects/2190cde267f946afa3cc9ab6c67c2ad4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:56.800810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:56.814228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5def3cf-e2a2-4142-9326-f6f4017eeaaa service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:56.905471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:56.908161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:56.908451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:56.908734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] PATH_INFO: `/v3/users/06be3869a2cb4608b004b757e7cf536b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:56.911296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06be3869a2cb4608b004b757e7cf536b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:56.918813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:57.020894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06be3869a2cb4608b004b757e7cf536b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.033941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06be3869a2cb4608b004b757e7cf536b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.049536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06be3869a2cb4608b004b757e7cf536b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.050882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06be3869a2cb4608b004b757e7cf536b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.059705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06be3869a2cb4608b004b757e7cf536b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.067242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 927/1892] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:56 2022] DELETE /identity/v3/users/06be3869a2cb4608b004b757e7cf536b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:57.442122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:57.443848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.462351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:57.463940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.468211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b2ed5-80df-43f6-91c7-00d0304caa4a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:57.549462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:57.568475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9e6a-7887-4c42-ab21-2e6df9803e70 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:57.576189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:57.577158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:57.577624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.578731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.579026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.579299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.579456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] PATH_INFO: `/v3/projects/94e826114baa4808af815a237496ea4e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.580521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] PATH_INFO: `/v3/users/0b1d11acf00645ce836267e3871ccd20` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.582470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1d11acf00645ce836267e3871ccd20)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:57.584549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e826114baa4808af815a237496ea4e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:57.585795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:57.586705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:57.608786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:57.664886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1d11acf00645ce836267e3871ccd20'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.676293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1d11acf00645ce836267e3871ccd20'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.676490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e826114baa4808af815a237496ea4e', 'request_id': 'req-39f95c29-d66f-498e-aeb2-5b37738f7e00'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.684077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e826114baa4808af815a237496ea4e', 'request_id': 'req-39f95c29-d66f-498e-aeb2-5b37738f7e00'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.696790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e826114baa4808af815a237496ea4e', 'request_id': 'req-39f95c29-d66f-498e-aeb2-5b37738f7e00'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.699479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1d11acf00645ce836267e3871ccd20'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.701302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1d11acf00645ce836267e3871ccd20'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.715707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] The token cache is being invalidate because project 94e826114baa4808af815a237496ea4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:57.716355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.717610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-39f95c29-d66f-498e-aeb2-5b37738f7e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.718985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-103ae2ae-a414-4bd7-a37f-551ba8bd8bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1d11acf00645ce836267e3871ccd20'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:57.722390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 966/1893] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:57 2022] DELETE /identity/v3/projects/94e826114baa4808af815a237496ea4e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:57.729139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245861-0096-4046-8690-9b62f566e830 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.729590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245861-0096-4046-8690-9b62f566e830 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.729866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245861-0096-4046-8690-9b62f566e830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.733372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 928/1894] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:57 2022] DELETE /identity/v3/users/0b1d11acf00645ce836267e3871ccd20 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:57.739102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215330e-f5ab-4b9d-b2f9-4868e3e01046 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.739401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215330e-f5ab-4b9d-b2f9-4868e3e01046 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.739750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215330e-f5ab-4b9d-b2f9-4868e3e01046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.781117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e2245861-0096-4046-8690-9b62f566e830 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:57.783644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2245861-0096-4046-8690-9b62f566e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.794479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1215330e-f5ab-4b9d-b2f9-4868e3e01046 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:57.796920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1215330e-f5ab-4b9d-b2f9-4868e3e01046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.885014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 967/1895] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:57.886267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245861-0096-4046-8690-9b62f566e830 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:57.887619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2245861-0096-4046-8690-9b62f566e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.894353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 929/1896] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:57.896125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.896606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.897043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.902076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245861-0096-4046-8690-9b62f566e830 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:57.907450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:57.908341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:57.908627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:57.908903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] PATH_INFO: `/v3/users/b5e2083949904f32b9eadb685f848037` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:57.910127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e2083949904f32b9eadb685f848037)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:57.912090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:57.919455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:57.920670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.930381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 930/1897] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:57.930787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:57.933119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:57.983637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e2083949904f32b9eadb685f848037'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.005650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e2083949904f32b9eadb685f848037'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.013436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e2083949904f32b9eadb685f848037'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.014259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e2083949904f32b9eadb685f848037'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.026907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e2083949904f32b9eadb685f848037'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.028749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:58.029574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682bc84-545a-4f05-bb65-b7f9d81d7c96 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.037472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.040862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 968/1898] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:57 2022] DELETE /identity/v3/users/b5e2083949904f32b9eadb685f848037 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:58.040862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.041094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.041094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.041228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.041299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.048292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.069201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.071164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6c4d5-b90c-4ebe-9692-a782889f8298 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.083131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 931/1899] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:58.084570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.084955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.085324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.105714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:58.107440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.133526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:58.163948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae8a4d-b443-4ffd-ae6c-548314af8cb9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.184661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.185703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.189335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.189846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.190822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:28:58.195323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 932/1900] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:58.197083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.199953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.203402 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.205639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.232258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 969/1901] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:28:58.233054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.253401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cff9c-6379-4644-8767-ebc9d79d67b1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.262937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.264233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.264856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.265778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.267655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.270276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.313160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 970/1902] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:58 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:58.314829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43dcc54-8434-4a5e-a943-0dac7384cb07 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.318025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.373841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.375041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.375397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.376102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.406320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d20ad8-8ee8-4884-a4a8-225e2a09ae0f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.411353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.412064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.412494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.412777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.413471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.415426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.450500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 971/1903] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:58 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:28:58.450500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.453330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.469473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.470937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.476202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7bc3-5477-4f81-bd9a-08242749c763 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.481548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 933/1904] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:28:58.484145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.494502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b900c8-f4df-40c2-9357-32da1f9941be service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.495226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.496665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.496958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.497244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] PATH_INFO: `/v3/users/da9ffabb0e584e189f5187085ef1984b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.498732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9ffabb0e584e189f5187085ef1984b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.500349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.501447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.501556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.501809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.502154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.502952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.504770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.516223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 934/1905] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:58.517048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.520145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.533622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96708657-f817-4333-8333-1c3e69007c74 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.539614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.540599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.540934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.541643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] PATH_INFO: `/v3/projects/2330a9a724ce4f0d9a64a3c49abd4008` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.543047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2330a9a724ce4f0d9a64a3c49abd4008)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.545161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.568871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:58.597514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9ffabb0e584e189f5187085ef1984b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.611971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:58.624103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9ffabb0e584e189f5187085ef1984b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.630871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2330a9a724ce4f0d9a64a3c49abd4008', 'request_id': 'req-3f942d12-ed7c-4e51-8520-6ac5714bb518'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.638712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9ffabb0e584e189f5187085ef1984b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.640825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9ffabb0e584e189f5187085ef1984b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.645774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2330a9a724ce4f0d9a64a3c49abd4008', 'request_id': 'req-3f942d12-ed7c-4e51-8520-6ac5714bb518'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.651679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9ffabb0e584e189f5187085ef1984b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.658549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2330a9a724ce4f0d9a64a3c49abd4008', 'request_id': 'req-3f942d12-ed7c-4e51-8520-6ac5714bb518'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.664750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 972/1906] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:58 2022] DELETE /identity/v3/users/da9ffabb0e584e189f5187085ef1984b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:58.666564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.668745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.698642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] The token cache is being invalidate because project 2330a9a724ce4f0d9a64a3c49abd4008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:58.698959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.700821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3f942d12-ed7c-4e51-8520-6ac5714bb518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.711421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 935/1907] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:58 2022] DELETE /identity/v3/projects/2330a9a724ce4f0d9a64a3c49abd4008 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:58.711421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.711421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.711421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.746784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:58.750710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.751245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d083f8-9c2f-4235-a586-2b03ecaf1d80 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.757007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.757796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.758125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.758550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.759279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.761100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.773692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 973/1908] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:58.774574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.778431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.787647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 936/1909] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:58.792112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a38c0-574a-4d28-8cfa-e925daab379d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.799207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.800434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.800883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.801317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] PATH_INFO: `/v3/users/ae4fd0d920344ce9b5aa55d32abe0442` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.802725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4fd0d920344ce9b5aa55d32abe0442)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.806217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.806772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.814594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.853647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5984-a7ac-47ba-814d-f96bcadca737 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:58.871023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:58.872070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.872351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.872622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] PATH_INFO: `/v3/projects/c4621f1de5fa4517a57da2fc93c29ce8/users/8dc9cecd30c349019561ab46b11e4b93/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:58.882377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4fd0d920344ce9b5aa55d32abe0442'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.896810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4fd0d920344ce9b5aa55d32abe0442'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.905004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4fd0d920344ce9b5aa55d32abe0442'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.906518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4fd0d920344ce9b5aa55d32abe0442'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.907671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4621f1de5fa4517a57da2fc93c29ce8, user_id=8dc9cecd30c349019561ab46b11e4b93, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:58.914465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120269f5-1fe2-4bd7-8996-d42dfb862d26 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:58.920254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4fd0d920344ce9b5aa55d32abe0442'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:58.933150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 974/1910] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:58 2022] DELETE /identity/v3/users/ae4fd0d920344ce9b5aa55d32abe0442 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:58.934343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:58.935825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:58.939961 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 937/1911] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:58 2022] PUT /identity/v3/projects/c4621f1de5fa4517a57da2fc93c29ce8/users/8dc9cecd30c349019561ab46b11e4b93/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:58.950484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:58.950820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:58.951041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.027146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] MFA Rules not processed for user `8dc9cecd30c349019561ab46b11e4b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:59.028432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.035087 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:59.075558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f9d45-5aeb-4b34-8073-b4285a9b8d0d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.082098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.082900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.083295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.083953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.091639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.184321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 938/1912] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:28:59.187915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.189411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.266855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.268928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.294274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 975/1913] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:28:59.297533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.307465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.310345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde70f8-0255-4168-bec3-e954f8882f09 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.319761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.320752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.321334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.321682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] PATH_INFO: `/v3/projects/ba52df844d9a47a2bfad58f17e56c3b6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.322372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5af4-7070-4ea4-8bf5-6a3cf58bc425 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.323176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba52df844d9a47a2bfad58f17e56c3b6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.325712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.328225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.328901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.329456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.329741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.330601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.332879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.337133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:59.395969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 976/1914] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:28:59 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:59.403996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.469747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba52df844d9a47a2bfad58f17e56c3b6', 'request_id': 'req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.482211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba52df844d9a47a2bfad58f17e56c3b6', 'request_id': 'req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.492394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba52df844d9a47a2bfad58f17e56c3b6', 'request_id': 'req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.503148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da88aa-df20-42b0-8667-59c6dfeac76a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.509495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] The token cache is being invalidate because project ba52df844d9a47a2bfad58f17e56c3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:59.510058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.510805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.514918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 939/1915] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:59 2022] DELETE /identity/v3/projects/ba52df844d9a47a2bfad58f17e56c3b6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:59.518682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.520331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.595272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.596000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.596291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.596580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.597465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.600524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.601857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e0e4a-9d3d-4d2c-9bc5-8118205572fa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.610661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.611965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.612491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.612491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] PATH_INFO: `/v3/users/793ac4a460c447caa0e0a786a1806d76` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.613817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=793ac4a460c447caa0e0a786a1806d76)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.615804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.624950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 977/1916] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:28:59 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:28:59.626942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.629927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.642017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:59.648959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179162a-64e9-4b36-bd70-4bb116af9541 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.658904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.660403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.660801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.661279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] PATH_INFO: `/v3/projects/baef637750da47e389e542f8c4538ba9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.663049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baef637750da47e389e542f8c4538ba9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.666067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.685404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793ac4a460c447caa0e0a786a1806d76'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.695383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793ac4a460c447caa0e0a786a1806d76'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.713316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793ac4a460c447caa0e0a786a1806d76'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.714238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793ac4a460c447caa0e0a786a1806d76'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.723742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793ac4a460c447caa0e0a786a1806d76'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.728516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baef637750da47e389e542f8c4538ba9', 'request_id': 'req-b6019aa5-e1d6-44c1-9b25-beafff562a35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.730780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 940/1917] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:59 2022] DELETE /identity/v3/users/793ac4a460c447caa0e0a786a1806d76 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:28:59.731599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.732941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.735877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baef637750da47e389e542f8c4538ba9', 'request_id': 'req-b6019aa5-e1d6-44c1-9b25-beafff562a35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.745559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baef637750da47e389e542f8c4538ba9', 'request_id': 'req-b6019aa5-e1d6-44c1-9b25-beafff562a35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.749324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:28:59.760706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] The token cache is being invalidate because project baef637750da47e389e542f8c4538ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:59.761171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.762323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.763886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 978/1918] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:59 2022] DELETE /identity/v3/projects/baef637750da47e389e542f8c4538ba9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:59.765717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.769337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.833186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889b205-ee10-4774-91db-cb3b5dc28465 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.838169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.838847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.839127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.839422 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.840154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.841773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d51d5-f674-4c00-aea3-544403b9aa45 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.849037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019aa5-e1d6-44c1-9b25-beafff562a35 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.853560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 941/1919] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:28:59.854557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.854838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.855028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.855648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.857453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.857799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.858639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] PATH_INFO: `/v3/projects/3f0e9e5c3320458a9dd24ab66b9cb028` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.860069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0e9e5c3320458a9dd24ab66b9cb028)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.861940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.875942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:59.877398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.886065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 942/1920] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:28:59.886610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.887894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.901949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d388bd7-35cd-44f7-b4fd-14c3e6f88dd5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:28:59.909449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:28:59.910506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.910898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.911401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] PATH_INFO: `/v3/projects/3076a23739d94f7e997c268d91d92a36/users/b91f4e0bc3d541ccad7ca2f2cd094b2f/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.929322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0e9e5c3320458a9dd24ab66b9cb028', 'request_id': 'req-c91b60ad-140c-45f9-8bb8-73dae7cee560'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.937134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0e9e5c3320458a9dd24ab66b9cb028', 'request_id': 'req-c91b60ad-140c-45f9-8bb8-73dae7cee560'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.945041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3076a23739d94f7e997c268d91d92a36, user_id=b91f4e0bc3d541ccad7ca2f2cd094b2f, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:28:59.947933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:28:59.950880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0e9e5c3320458a9dd24ab66b9cb028', 'request_id': 'req-c91b60ad-140c-45f9-8bb8-73dae7cee560'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.967898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] The token cache is being invalidate because project 3f0e9e5c3320458a9dd24ab66b9cb028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:28:59.968366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.969080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c91b60ad-140c-45f9-8bb8-73dae7cee560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:28:59.970977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 979/1921] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:28:59 2022] DELETE /identity/v3/projects/3f0e9e5c3320458a9dd24ab66b9cb028 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:59.972546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:28:59.972857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:28:59.973145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:28:59.975086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 943/1922] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:28:59 2022] PUT /identity/v3/projects/3076a23739d94f7e997c268d91d92a36/users/b91f4e0bc3d541ccad7ca2f2cd094b2f/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:28:59.980582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:28:59.983904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:28:59.995465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:28:59.996745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.010981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:00.085334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b67ff-5184-4ff0-b694-c728bd76c054 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.088505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 980/1923] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:00.089393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.094312 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.099456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.100482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.100640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.100920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] PATH_INFO: `/v3/users/7eabedab0a0446248563d3bf09b90d4f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.102308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eabedab0a0446248563d3bf09b90d4f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.104377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.108693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c6c71-69b1-46aa-a32d-17de72333a65 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.114105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.114823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.115107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.115412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.116180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.117799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.129714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 981/1924] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:00.133801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.137033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.160457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f8b88-0cf6-4fac-ac0b-addae78455b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.166008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.166894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eabedab0a0446248563d3bf09b90d4f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.167022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.167561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.168048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] PATH_INFO: `/v3/projects/d7bba13706e147e9872c7c61b133d1c4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.169597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bba13706e147e9872c7c61b133d1c4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.174014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.176795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eabedab0a0446248563d3bf09b90d4f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.221873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eabedab0a0446248563d3bf09b90d4f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.223650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eabedab0a0446248563d3bf09b90d4f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.236036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eabedab0a0446248563d3bf09b90d4f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.238289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:00.246069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 944/1925] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:28:59 2022] DELETE /identity/v3/users/7eabedab0a0446248563d3bf09b90d4f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:00.250964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.254099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.263767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bba13706e147e9872c7c61b133d1c4', 'request_id': 'req-776b8670-a884-4704-b624-e6a64171893c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.269893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bba13706e147e9872c7c61b133d1c4', 'request_id': 'req-776b8670-a884-4704-b624-e6a64171893c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.278857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bba13706e147e9872c7c61b133d1c4', 'request_id': 'req-776b8670-a884-4704-b624-e6a64171893c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.292606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] The token cache is being invalidate because project d7bba13706e147e9872c7c61b133d1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:00.292897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.293811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.297224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 982/1926] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:00 2022] DELETE /identity/v3/projects/d7bba13706e147e9872c7c61b133d1c4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:00.298098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.299543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.352432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f78eb-48fb-4070-b09b-66313075d561 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.360132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.361219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.361732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.362125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.364152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:00.364543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.371686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cf053-90b5-42a9-8d37-6f34631c0816 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.401758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 945/1927] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:00.403533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.403904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.404261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.426594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:00.428207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.435467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b8670-a884-4704-b624-e6a64171893c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.438815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 946/1928] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:00.441548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.442630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.442922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.443202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] PATH_INFO: `/v3/projects/3076a23739d94f7e997c268d91d92a36/users/b91f4e0bc3d541ccad7ca2f2cd094b2f/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.444340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.446049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3076a23739d94f7e997c268d91d92a36, user_id=b91f4e0bc3d541ccad7ca2f2cd094b2f, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.448594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.449141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b62b29-d584-44e6-a8aa-888e281ab85b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.463428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c69b-9f83-4f75-8c97-30cf0de0fe5a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.467499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 983/1929] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:00 2022] PUT /identity/v3/projects/3076a23739d94f7e997c268d91d92a36/users/b91f4e0bc3d541ccad7ca2f2cd094b2f/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:00.470106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28531-816e-4571-a2af-b334d597976b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.470602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28531-816e-4571-a2af-b334d597976b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.471059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a28531-816e-4571-a2af-b334d597976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.525243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f0a28531-816e-4571-a2af-b334d597976b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:00.526496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f0a28531-816e-4571-a2af-b334d597976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.574951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:00.575853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.576857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.577257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.577585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.578695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.582179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fcc2d-555b-40f1-a749-db2c41665c3a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.657450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 947/1930] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:00.664837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.668631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.669419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 984/1931] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:00.671407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a28531-816e-4571-a2af-b334d597976b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.673678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.684170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a28531-816e-4571-a2af-b334d597976b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.718072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] MFA Rules not processed for user `b91f4e0bc3d541ccad7ca2f2cd094b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:00.719905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.763341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.765162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.765673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.765960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.767014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.768641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.789921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 985/1932] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:00.790443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:00.790745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.804317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4723a-4582-4287-8a14-2a5b93801692 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.804827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 948/1933] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:00.805718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.807168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.816149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.816911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.817294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.817642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.818390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:00.818701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.820399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.830678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b82f12-1de0-454f-b69a-1e537d9e0675 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.835508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 986/1934] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:00.835672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.836466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.836578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.836757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.837153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] PATH_INFO: `/v3/projects/19130bf42e48441ebbd0956d9592eba8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.838352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19130bf42e48441ebbd0956d9592eba8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.840731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.847746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e2910-b478-4c65-99a2-7b4a7fc8e05f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.852411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.853074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.853357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.853637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.854360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:00.856023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:00.867814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 987/1935] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:00.868662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.870664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.896671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19130bf42e48441ebbd0956d9592eba8', 'request_id': 'req-b46769ef-13e7-4517-8eda-f211cab02659'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.906054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19130bf42e48441ebbd0956d9592eba8', 'request_id': 'req-b46769ef-13e7-4517-8eda-f211cab02659'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.912192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19130bf42e48441ebbd0956d9592eba8', 'request_id': 'req-b46769ef-13e7-4517-8eda-f211cab02659'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.924483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] The token cache is being invalidate because project 19130bf42e48441ebbd0956d9592eba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:00.924701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.925438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:00.927109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 949/1936] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:00 2022] DELETE /identity/v3/projects/19130bf42e48441ebbd0956d9592eba8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:00.927911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:00.929211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.937525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdbf05-f97f-43e0-b7d0-2d8fb1af5f43 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:00.983654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:00.989696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:00.990550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:00.991011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:00.991413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:00.993354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:00.995294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769ef-13e7-4517-8eda-f211cab02659 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.000249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.000913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.001196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.001472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.002166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.004123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.031263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 950/1937] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:00 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.032230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.033856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.058735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.060262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a8913-d2f0-4bbd-af23-3c3e9ff636ef service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.070170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 988/1938] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:01.071470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.071764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.072041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.090645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:01.092670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.106096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381dc3-75bb-4e31-85e4-6ccf095c4a26 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.113137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.113823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.114107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.114379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.115409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.117065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.122618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:01.132464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 951/1939] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:01.133622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.146303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe16c-564b-4e3f-b788-06715745c484 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.151017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.151738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.152025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.152314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.153017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.155102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.159951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 989/1940] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:01.160793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.162081 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.183629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 952/1941] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.183629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.192811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce852-ceee-40a8-8977-436a86da4e03 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.197484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.198361 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.198646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.198924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] PATH_INFO: `/v3/projects/2a261c49ec354718b8c9a4436b87f406/users/3cf018db8d5644be86497bb36a721940/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.222488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a261c49ec354718b8c9a4436b87f406, user_id=3cf018db8d5644be86497bb36a721940, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.225300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c55274-5364-444e-80a0-d45558a6602f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.232477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b191-9bec-4264-89f6-123b0af9e40d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.238147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.239115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.239412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.239699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.241599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.243977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 953/1942] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:01 2022] PUT /identity/v3/projects/2a261c49ec354718b8c9a4436b87f406/users/3cf018db8d5644be86497bb36a721940/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:01.245193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88822-9f9f-4782-8396-49f4ad3322ef None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.245488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88822-9f9f-4782-8396-49f4ad3322ef None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.245763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e88822-9f9f-4782-8396-49f4ad3322ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.270725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-74e88822-9f9f-4782-8396-49f4ad3322ef None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:01.271971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74e88822-9f9f-4782-8396-49f4ad3322ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.293660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:01.305230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.306683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.316394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 990/1943] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:01.317212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.330174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bf29-935c-4774-bca0-87c79e765af4 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.335100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.335840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.336147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.336292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 954/1944] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:01.339597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.339597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.339799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.339799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.339799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.340026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.351194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 991/1945] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:01.352057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.362655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1685-114c-4887-8c9f-625a9a65d51d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.368149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.368845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.369133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.369362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] MFA Rules not processed for user `3cf018db8d5644be86497bb36a721940`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:01.369507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.370244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:01.370554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.370651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.372192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.386824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 992/1946] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:01.387833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.400468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85077960-0d1b-4ecd-b667-5e5501f0f606 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.405669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.406483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.406873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.407251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.408104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.409787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.420765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 993/1947] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:01.421659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.431979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c5fa5-94c8-40d4-a598-8b7181399cb3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.437384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.437989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.438279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.438557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.439248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.441292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.455031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 955/1948] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:01.455905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.469071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34437b4-dd28-41e7-9bab-289b65b09361 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.473920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.474822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.475156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.475392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] PATH_INFO: `/v3/projects/f85f6442a47b49e0bad2d5be50da4ba5/users/ac93ded98e7546679f4c640a5d4642fb/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.481458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 994/1949] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.481458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.496972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85f6442a47b49e0bad2d5be50da4ba5, user_id=ac93ded98e7546679f4c640a5d4642fb, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.501006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.516797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 956/1950] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:01 2022] PUT /identity/v3/projects/f85f6442a47b49e0bad2d5be50da4ba5/users/ac93ded98e7546679f4c640a5d4642fb/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:01.517984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.548818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:01.578642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a7468-df70-4a95-b77f-c64cbf9243bb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.595087 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb570686-c25b-4f96-94b9-bd4cc55d3be1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.600249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.600945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.601229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.601505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.602330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.604343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b2c13-f103-490f-b2c9-d805fe84bfed admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.630058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 957/1951] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.632286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.632286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.632477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.684760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] MFA Rules not processed for user `ac93ded98e7546679f4c640a5d4642fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:01.686231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.710995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.712569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.712875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.713158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.713932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.717886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.762570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 995/1952] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/projects => generated 387 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.764709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.784346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 958/1953] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:01.785197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.798672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7431b16-d8a5-41e3-9d0e-8fde8f87822a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.813906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:01.867033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb81d76-d2c4-4905-a0f5-07e15c7a9091 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:01.874501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.875582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.875906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.876327 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.877447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.879979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.910345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 996/1954] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:01.914367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:01.917282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:01.920103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:01.921586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:01.923722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:01.925189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:01.926079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:01.932037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:01.996620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 959/1955] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:01 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:01.999821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.019652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c2ae-67f1-4e2b-8e25-67d199eb16d9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.029839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.030711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.031002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.031279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.033436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.037207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.037809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccc60-3038-41a1-baf0-3189c7c60a34 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.042156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.042988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.043402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.043782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.053019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 960/1956] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:02.054071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.072162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2038b30-2b5b-4022-a918-d3d26727a72d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.087699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.088472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.088760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.089034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.089771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.091675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.108228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 961/1957] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:02.109224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.122958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9a976-20b9-4230-b96f-c2509a7425ee admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.130050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.131322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.131654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.131934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] PATH_INFO: `/v3/projects/beb7a2da949a4e8190e7a75a8c54e9f4/users/84ef3db0e59a49a8ac51a292b1cd0880/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.143906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.144114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:02.145360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.155876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 997/1958] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:02.158363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.170399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb7a2da949a4e8190e7a75a8c54e9f4, user_id=84ef3db0e59a49a8ac51a292b1cd0880, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.178275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674ffe-706a-4990-99ab-2935c8581b16 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.181278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a6dad-64b9-4b73-8a6e-48270ba57f55 service glance] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.192019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.193255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.193693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.194726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] PATH_INFO: `/v3/projects/8c157220fad741a98bf271e2f89fb122/users/e81cac321a7b4dbb83437cabf9e8f171/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.219883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c157220fad741a98bf271e2f89fb122, user_id=e81cac321a7b4dbb83437cabf9e8f171, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.220864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 962/1959] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:02 2022] PUT /identity/v3/projects/beb7a2da949a4e8190e7a75a8c54e9f4/users/84ef3db0e59a49a8ac51a292b1cd0880/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:02.231507 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.232070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.232435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.232690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.258574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 998/1960] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:02 2022] PUT /identity/v3/projects/8c157220fad741a98bf271e2f89fb122/users/e81cac321a7b4dbb83437cabf9e8f171/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:02.260307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.275221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] MFA Rules not processed for user `84ef3db0e59a49a8ac51a292b1cd0880`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:02.277687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:02.332480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:02.350595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cc2a4-0612-4343-b2e8-147a92c5a538 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.355495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.356177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.356458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.356834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.357654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.359383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.369282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 963/1961] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:02.374204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.379636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 999/1962] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:02.380756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.389780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5632a1-f6e5-4f55-86a6-2947c1dad154 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.393539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a767ab-51e1-4ed3-89b8-b93125ef14d6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.395100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.395805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.396094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.396442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.397174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.399099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.399213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.400129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.400382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.400658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] PATH_INFO: `/v3/projects/8c157220fad741a98bf271e2f89fb122/users/e81cac321a7b4dbb83437cabf9e8f171/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.402641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c157220fad741a98bf271e2f89fb122, user_id=e81cac321a7b4dbb83437cabf9e8f171, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.406632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a835c7-88ae-405a-ac6e-7db21077ef2f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.427629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1000/1963] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:02 2022] PUT /identity/v3/projects/8c157220fad741a98bf271e2f89fb122/users/e81cac321a7b4dbb83437cabf9e8f171/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:02.429834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.430624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.431071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.441485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 964/1964] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:02 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:02.446798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.463881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] MFA Rules not processed for user `e81cac321a7b4dbb83437cabf9e8f171`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:02.465100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:02.526441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9fbf6-7e48-4a6e-8700-e2756cd59818 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.533067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.534255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.534543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.534872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.536058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.538136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.550013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1001/1965] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:02.562959 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.564570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:02.571146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 965/1966] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:02 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:02.572254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.583776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15195b8d-11dd-4467-b382-3178af458384 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.589220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.589995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.590334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.590701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.591828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.593610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.607959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 966/1967] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:02.611629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.623051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2793f0e-0929-43e0-8de4-7fe579010b96 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.630333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.631694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.632214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.633138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] PATH_INFO: `/v3/projects/98186fc3a8a949f9a3037a17c96308bd/users/fd91b7fbf92f4f379679107decde551b/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.636558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54ba3-4f74-4de8-9af3-51798f3247fa None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.641066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.641853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.642584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.642584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.652891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98186fc3a8a949f9a3037a17c96308bd, user_id=fd91b7fbf92f4f379679107decde551b, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.654485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.656052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.656990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.668349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1002/1968] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:02.681421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 967/1969] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:02 2022] PUT /identity/v3/projects/98186fc3a8a949f9a3037a17c96308bd/users/fd91b7fbf92f4f379679107decde551b/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:02.686589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.704303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65764173-a763-4595-8b20-cfa7afb3e954 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:02.720020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:02.731926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:02.956784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:02.957622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:02.959223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:02.960047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:02.961746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:02.967158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:02.991423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:03.006686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b4ae1-fd27-44e5-8492-69d2d689a145 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:03.008713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1003/1970] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:03.012454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:03.036182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7129ebb-047b-41ee-b56b-216b222b34bb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:03.039098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:03.039642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.039927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.040202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] PATH_INFO: `/v3/users/3cf018db8d5644be86497bb36a721940` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.042690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf018db8d5644be86497bb36a721940)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:03.044927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:03.055797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:03.057000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.057290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.057572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] PATH_INFO: `/v3/projects/98186fc3a8a949f9a3037a17c96308bd/users/fd91b7fbf92f4f379679107decde551b/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.062798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98186fc3a8a949f9a3037a17c96308bd, user_id=fd91b7fbf92f4f379679107decde551b, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:03.065739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02da4b-ca56-48ec-b16b-c3a7606c76b3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:03.096486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1004/1971] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:03 2022] PUT /identity/v3/projects/98186fc3a8a949f9a3037a17c96308bd/users/fd91b7fbf92f4f379679107decde551b/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:03.107784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.108078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.108359 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.169374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] MFA Rules not processed for user `fd91b7fbf92f4f379679107decde551b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:03.174596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:03.216042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf018db8d5644be86497bb36a721940'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:03.254654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf018db8d5644be86497bb36a721940'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:03.305003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf018db8d5644be86497bb36a721940'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:03.307816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf018db8d5644be86497bb36a721940'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:03.326956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e224b4be-7c25-44df-a20e-a47e6f785bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf018db8d5644be86497bb36a721940'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:03.338945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 968/1972] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:02 2022] DELETE /identity/v3/users/3cf018db8d5644be86497bb36a721940 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:03.350272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575650-4005-4e2c-9563-9a2784481094 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.350272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575650-4005-4e2c-9563-9a2784481094 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.350272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575650-4005-4e2c-9563-9a2784481094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.373243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-80575650-4005-4e2c-9563-9a2784481094 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:03.374701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-80575650-4005-4e2c-9563-9a2784481094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:03.424661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1005/1973] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:03.502511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 969/1974] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:03.508377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:03.509929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:03.550027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575650-4005-4e2c-9563-9a2784481094 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:03.552362 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-80575650-4005-4e2c-9563-9a2784481094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:03.631709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d238897-d156-4074-b6d7-34d104ce2a80 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:03.640359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:03.698947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575650-4005-4e2c-9563-9a2784481094 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:03.707894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:03.708574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.709649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.709938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.723804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:03.725570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:03.735983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:03.736665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:03.737567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:03.738046 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:03.739538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 970/1975] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:03.834872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:03.873421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:03.875510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:03.892907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1006/1976] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:04.106455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:04.108391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:04.128060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3045c-881e-4a07-b652-ab22b33c599f service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:04.133314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:04.134176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:04.134477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:04.134842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] PATH_INFO: `/v3/projects/2a261c49ec354718b8c9a4436b87f406` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:04.136010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a261c49ec354718b8c9a4436b87f406)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:04.138280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:04.183145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:04.186474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:04.198455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22856e-6529-48c1-b2a8-ac3d194a9864 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:04.201103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a261c49ec354718b8c9a4436b87f406', 'request_id': 'req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.213810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a261c49ec354718b8c9a4436b87f406', 'request_id': 'req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.223882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a261c49ec354718b8c9a4436b87f406', 'request_id': 'req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.239054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] The token cache is being invalidate because project 2a261c49ec354718b8c9a4436b87f406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:04.239054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.239054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.239989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 971/1977] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:04 2022] DELETE /identity/v3/projects/2a261c49ec354718b8c9a4436b87f406 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:04.244419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:04.246680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:04.280052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:04.281220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:04.282170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:04.282170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:04.284089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:04.385311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b88e4-7b97-48f7-8ddb-2a509b78d3f3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:04.391252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:04.392103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:04.392388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:04.392659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] PATH_INFO: `/v3/users/e81cac321a7b4dbb83437cabf9e8f171` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:04.393946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81cac321a7b4dbb83437cabf9e8f171)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:04.396221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:04.403239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:04.405465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:04.422444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1007/1978] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:04.500613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81cac321a7b4dbb83437cabf9e8f171'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.511315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81cac321a7b4dbb83437cabf9e8f171'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.514952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:04.538562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81cac321a7b4dbb83437cabf9e8f171'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.539633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81cac321a7b4dbb83437cabf9e8f171'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.551292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a05a6ffc-3863-4378-8118-8a9912f19cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81cac321a7b4dbb83437cabf9e8f171'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:04.559149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 972/1979] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:04 2022] DELETE /identity/v3/users/e81cac321a7b4dbb83437cabf9e8f171 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:05.179691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.191455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd36685-6f00-4af7-926b-29b42d63b697 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.263711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.264704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.264992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.265272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] PATH_INFO: `/v3/projects/8c157220fad741a98bf271e2f89fb122` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.266679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c157220fad741a98bf271e2f89fb122)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.268602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.310716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:05.321547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c157220fad741a98bf271e2f89fb122', 'request_id': 'req-053bd1f8-947b-4e91-b7c0-f03866844df2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:05.332096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c157220fad741a98bf271e2f89fb122', 'request_id': 'req-053bd1f8-947b-4e91-b7c0-f03866844df2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:05.340966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c157220fad741a98bf271e2f89fb122', 'request_id': 'req-053bd1f8-947b-4e91-b7c0-f03866844df2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:05.353813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] The token cache is being invalidate because project 8c157220fad741a98bf271e2f89fb122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:05.354226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:05.354878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-053bd1f8-947b-4e91-b7c0-f03866844df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:05.358827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1008/1980] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:05 2022] DELETE /identity/v3/projects/8c157220fad741a98bf271e2f89fb122 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:05.363827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.365782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.366300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.392496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:05.393776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:05.483488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 973/1981] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:05.491288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.491610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.491889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.519726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:05.520941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:05.561887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1009/1982] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:05.567197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.588036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ce37-602b-4bad-a804-e4e9812d8498 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.599902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.600626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.600957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.601284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.602062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:05.602372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.604805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.625430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 974/1983] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:05.635104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.654316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfff7e-ddc7-4337-8dbd-083db4e00578 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.667198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.668563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.668942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.669194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.669855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.675615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.696022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.698924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:05.740441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1010/1984] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:05 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:05.741693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.745329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45450396-baa7-4d50-be38-523cd08467dd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.840245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936934ce-668f-45c1-a5ec-3aeaf931acac admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.841003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.841370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.841974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.842405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] PATH_INFO: `/v3/users/8dc9cecd30c349019561ab46b11e4b93` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.843976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc9cecd30c349019561ab46b11e4b93)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.846764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.849014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.849778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.850142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.850494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.851262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.853338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.936244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1011/1985] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:05 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:05.940731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.962484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629909a-65b8-4085-ac92-decb21d546de admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:05.970816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:05.971938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:05.972224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:05.972502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:05.973736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:05.975385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:05.989119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1012/1986] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:05.993031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:05.999820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc9cecd30c349019561ab46b11e4b93'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:06.011680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebe813-3813-4460-8ee0-a2d9f7385c30 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.014769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc9cecd30c349019561ab46b11e4b93'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:06.024193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.025416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.025823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.025943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:06.027031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.030027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.032844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.046528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc9cecd30c349019561ab46b11e4b93'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:06.049846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc9cecd30c349019561ab46b11e4b93'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:06.058728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1013/1987] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:06.069022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ca1a9ddd-74a4-41a0-bb47-efb27e75af8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc9cecd30c349019561ab46b11e4b93'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:06.072132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.075770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:06.077611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 975/1988] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:05 2022] DELETE /identity/v3/users/8dc9cecd30c349019561ab46b11e4b93 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:06.083250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.083566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.083851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.119241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:06.121521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:06.121673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb28a-4ec8-4e6f-aebb-3aefc0d702a0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.225124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 976/1989] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:06.236151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.237545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:06.276181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.277424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.277762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.277944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] PATH_INFO: `/v3/projects/faf38ff592ed46b7b0848af1f26e3277/users/05ed31585b8342b7b48fd9ac196837c0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.286587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:06.312149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf38ff592ed46b7b0848af1f26e3277, user_id=05ed31585b8342b7b48fd9ac196837c0, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.314960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3bad6-03bd-4e53-b553-da2e508c5113 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.352817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf3b77-0bdd-4c86-9e3a-12c24e6db1c0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.368950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1014/1990] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:06 2022] PUT /identity/v3/projects/faf38ff592ed46b7b0848af1f26e3277/users/05ed31585b8342b7b48fd9ac196837c0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:06.373815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.374135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.375421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.440420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] MFA Rules not processed for user `05ed31585b8342b7b48fd9ac196837c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:06.441671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:06.471484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.472152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.472440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.472739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.519465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1015/1991] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:06.523893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.528642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:06.548788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.550494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.562818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 977/1992] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:06.596815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783901f8-5933-4d6a-b374-6a64ee9a4342 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.601671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.602346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.602631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.602910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.603636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.606540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.636769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1016/1993] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:06 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:06.638212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.649843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52505601-d83b-4179-a853-088b2bded248 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.722067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.722762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.723050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.723330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.724090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.726153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.749715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 978/1994] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:06 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:06.753388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.767180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec84f4-32be-4ec7-88d9-1d9658bbd660 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.773128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.773818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.774104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.774387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.775214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.777717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.789333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1017/1995] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:06.793881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.804298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1147fe8-2268-403b-b9a2-4e533c5ffb5b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.809255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.810159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.810440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.810851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] PATH_INFO: `/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf/users/39fbb72e5b1344d593716f5c83f9943a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.835589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8043a63f2a4aa99a6dbd98cd015bcf, user_id=39fbb72e5b1344d593716f5c83f9943a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.838533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.860010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 979/1996] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:06 2022] PUT /identity/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf/users/39fbb72e5b1344d593716f5c83f9943a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:06.864035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.865454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:06.868100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:06.893082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79b499-49b6-4c93-90f1-841c4cf0cee9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.947612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7093630-8449-45aa-a39a-b87a5d3624d8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:06.953696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.954910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.955193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.955497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] PATH_INFO: `/v3/projects/c4621f1de5fa4517a57da2fc93c29ce8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.956285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:06.956784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4621f1de5fa4517a57da2fc93c29ce8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.958951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.976790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:06.979994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:06.980564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:06.980894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:06.981735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:06.983477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:06.997308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1018/1997] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:07.001682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:07.016420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c647027-cca8-4850-a8b8-1a005071b9f7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:07.022388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:07.023340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:07.023657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:07.024232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] PATH_INFO: `/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf/users/39fbb72e5b1344d593716f5c83f9943a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:07.027244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8043a63f2a4aa99a6dbd98cd015bcf, user_id=39fbb72e5b1344d593716f5c83f9943a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:07.029989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658cb88-635f-4164-a080-edfb6dce3c0e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:07.034317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4621f1de5fa4517a57da2fc93c29ce8', 'request_id': 'req-ed40600d-8cd6-48ab-acdf-f5679f4df175'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.038542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:07.045022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4621f1de5fa4517a57da2fc93c29ce8', 'request_id': 'req-ed40600d-8cd6-48ab-acdf-f5679f4df175'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.048034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1019/1998] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:07 2022] PUT /identity/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf/users/39fbb72e5b1344d593716f5c83f9943a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:07.052333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4621f1de5fa4517a57da2fc93c29ce8', 'request_id': 'req-ed40600d-8cd6-48ab-acdf-f5679f4df175'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.059071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:07.059332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:07.059652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:07.066713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] The token cache is being invalidate because project c4621f1de5fa4517a57da2fc93c29ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:07.067002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.067824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.069437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 980/1999] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:06 2022] DELETE /identity/v3/projects/c4621f1de5fa4517a57da2fc93c29ce8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:07.083978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:07.091555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:07.094942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] MFA Rules not processed for user `39fbb72e5b1344d593716f5c83f9943a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:07.097307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:07.208355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40600d-8cd6-48ab-acdf-f5679f4df175 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:07.278347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1020/2000] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:07.286354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:07.287850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:07.329696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:07.330837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:07.331293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:07.331627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] PATH_INFO: `/v3/users/b91f4e0bc3d541ccad7ca2f2cd094b2f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:07.332999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91f4e0bc3d541ccad7ca2f2cd094b2f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:07.337200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:07.366237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963045-58e0-41fc-8da4-65e95dae27ca None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:07.371742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:07.373780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:07.373780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:07.373780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:07.375190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:07.398808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91f4e0bc3d541ccad7ca2f2cd094b2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.409400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91f4e0bc3d541ccad7ca2f2cd094b2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.448948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91f4e0bc3d541ccad7ca2f2cd094b2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.451513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91f4e0bc3d541ccad7ca2f2cd094b2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.469168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:07.472302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:07.475742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9d802c60-dde9-47dc-b1a7-f7a5642dca41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91f4e0bc3d541ccad7ca2f2cd094b2f'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:07.491621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1021/2001] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:07.496931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 981/2002] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:07 2022] DELETE /identity/v3/users/b91f4e0bc3d541ccad7ca2f2cd094b2f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:08.053727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.087892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d4030-3fec-4f84-a169-4742be12f85f service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.116202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:08.194488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.195654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.196024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.196370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] PATH_INFO: `/v3/projects/3076a23739d94f7e997c268d91d92a36` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.198154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3076a23739d94f7e997c268d91d92a36)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.205055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.288472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3076a23739d94f7e997c268d91d92a36', 'request_id': 'req-6912658b-ac75-432e-91b3-d16caa9a8e7d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:08.308466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3076a23739d94f7e997c268d91d92a36', 'request_id': 'req-6912658b-ac75-432e-91b3-d16caa9a8e7d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:08.322036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3076a23739d94f7e997c268d91d92a36', 'request_id': 'req-6912658b-ac75-432e-91b3-d16caa9a8e7d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:08.337735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] The token cache is being invalidate because project 3076a23739d94f7e997c268d91d92a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:08.338681 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:08.339498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6912658b-ac75-432e-91b3-d16caa9a8e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:08.341051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1022/2003] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:08 2022] DELETE /identity/v3/projects/3076a23739d94f7e997c268d91d92a36 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:08.352665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.352898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.353177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.374674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:08.375936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:08.380879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:08.492712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 982/2004] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:08.494943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.495385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.495830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.526017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:08.529171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:08.542945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1023/2005] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:08.548324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.565180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e23c7a-9f66-4a09-b489-de094ccb9779 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.572441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.573452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.573954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.574477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.575587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:08.575995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.578014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.592068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 983/2006] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:08.596243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.608548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ad9f5-a9d6-4bfb-85f3-650cad7c1041 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.615355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.616108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.616394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.616666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.617357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.620206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.649531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1024/2007] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:08 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:08.652942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.670861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31850a-f3c1-4f22-9ea8-fb72885cce7d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.737344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.738325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.738609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.738885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.739618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.741531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.766011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 984/2008] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:08 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:08.770038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.780248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557f91-fe48-4eff-bda5-494ce727abb2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.785088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.785899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.786204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.786473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.787311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.788945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.799628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1025/2009] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:08.803745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.815727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85a78c-214f-4cf6-9e66-dbcc1aa58e76 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.820533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.821320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.821616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.821887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.823269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.825364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64c65b-4c6e-4567-b9be-d3df491c0825 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.836253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 985/2010] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:08.840844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:08.850878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a4ce0-c54e-4f8f-b520-2c585e69a2d2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:08.855740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:08.856688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.856994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.857277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] PATH_INFO: `/v3/projects/495456d6a9fb4a6288c839c2b14eb656/users/94e8cf92aae044c0bc25718a1f6b42ef/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.873510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495456d6a9fb4a6288c839c2b14eb656, user_id=94e8cf92aae044c0bc25718a1f6b42ef, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:08.876696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:08.891221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1026/2011] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:08 2022] PUT /identity/v3/projects/495456d6a9fb4a6288c839c2b14eb656/users/94e8cf92aae044c0bc25718a1f6b42ef/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:08.901346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:08.901646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:08.901924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:08.927905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] MFA Rules not processed for user `94e8cf92aae044c0bc25718a1f6b42ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:08.929152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:08.997339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 986/2012] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:09.001791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.043324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:09.066097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596cbef-0a6b-49ab-8a5d-4c128751a857 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.070891 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.071586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.071877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.072329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.073063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.075330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.111000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1027/2013] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:09 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:09.115177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.123381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:09.129078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee95d5-07b6-4e30-8d6c-7f40db665e9f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.146316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.148053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:09.189847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.190523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.190805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.191078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.191808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.193729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.212517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4a938-bb51-4177-8da7-a692ba53510a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.216687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.217355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.217645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.217924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.221423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 987/2014] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:09 2022] POST /identity/v3/users => generated 306 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:09.221566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:09.222424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.233196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cc1b-f162-4dba-a41e-182c35fc4089 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.237773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.238418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.238698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.238975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.239725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.241316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.252701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 988/2015] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:09.256636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.271206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d9f9-ccb4-4255-807d-c23a257ff5f0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.276569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.277743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.278023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.278298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] PATH_INFO: `/v3/projects/1321f85f0cf0468596717e29864ee189/users/44a73ecc598a4b17ad654641bf4a4dd2/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.290185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.292470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.295986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1321f85f0cf0468596717e29864ee189, user_id=44a73ecc598a4b17ad654641bf4a4dd2, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.298864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.303388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1028/2016] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:09.315720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 989/2017] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:09 2022] PUT /identity/v3/projects/1321f85f0cf0468596717e29864ee189/users/44a73ecc598a4b17ad654641bf4a4dd2/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:09.319561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.331257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270400b7-4546-4024-b20e-bd08522db675 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.434685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.435356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.438472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.438472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.438472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.438677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951d32-bf6e-453e-90c5-e9a17d660290 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.461304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1029/2018] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:09.463245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.474641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779933f-dd03-424c-bf1a-8b1c571e0220 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.480561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.481841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.482222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.482663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] PATH_INFO: `/v3/projects/1321f85f0cf0468596717e29864ee189/users/44a73ecc598a4b17ad654641bf4a4dd2/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.484895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1321f85f0cf0468596717e29864ee189, user_id=44a73ecc598a4b17ad654641bf4a4dd2, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.488017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.504768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 990/2019] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:09 2022] PUT /identity/v3/projects/1321f85f0cf0468596717e29864ee189/users/44a73ecc598a4b17ad654641bf4a4dd2/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:09.518091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.518393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.518720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.544088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:09.559557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] MFA Rules not processed for user `44a73ecc598a4b17ad654641bf4a4dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:09.561845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:09.651935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1030/2020] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:09.666844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.730261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2bf19-b17b-41a9-8e56-fea305ca24a8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.734083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.734739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.735028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.735310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.744840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:09.746483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:09.760316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 991/2021] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:09.909506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:09.929942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624b8f3-955c-4353-86f0-5ee7e4a74d6c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:09.934827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:09.935507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:09.936015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:09.936660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:09.999948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:10.001241 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67403b-d642-42e8-a8a0-b13771dc092c service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:10.019905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1031/2022] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:12.510948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:12.512568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:12.615385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:12.633870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867eab2-fb84-4d78-a603-94f8c8520a96 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:12.639117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:12.640118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:12.640480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:12.641241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] PATH_INFO: `/v3/users/84ef3db0e59a49a8ac51a292b1cd0880` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:12.642546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ef3db0e59a49a8ac51a292b1cd0880)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:12.644687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:12.718533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ef3db0e59a49a8ac51a292b1cd0880'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:12.726886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ef3db0e59a49a8ac51a292b1cd0880'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:12.741014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ef3db0e59a49a8ac51a292b1cd0880'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:12.744154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ef3db0e59a49a8ac51a292b1cd0880'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:12.762987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ef3db0e59a49a8ac51a292b1cd0880'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:12.781955 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 992/2023] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:12 2022] DELETE /identity/v3/users/84ef3db0e59a49a8ac51a292b1cd0880 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:12.783684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:12.784230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:12.784320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:12.830446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:12.831427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:12.966598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1032/2024] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:13.002581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:13.004684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:13.081267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d60f3-41a6-48fc-8e7d-82fa52124d4c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:13.087105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:13.089067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:13.089907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:13.090681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:13.106624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:13.108232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:13.126491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 993/2025] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:13.975615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:13.978364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:14.002353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac9efd-cc33-42b9-a5eb-99c6b59d7832 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:14.009176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:14.010420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.010850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.011284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] PATH_INFO: `/v3/projects/beb7a2da949a4e8190e7a75a8c54e9f4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.012875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb7a2da949a4e8190e7a75a8c54e9f4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:14.015159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:14.062722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:14.093308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb7a2da949a4e8190e7a75a8c54e9f4', 'request_id': 'req-36ac472d-9352-4459-9463-0c1181b2c489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.104239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb7a2da949a4e8190e7a75a8c54e9f4', 'request_id': 'req-36ac472d-9352-4459-9463-0c1181b2c489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.114418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb7a2da949a4e8190e7a75a8c54e9f4', 'request_id': 'req-36ac472d-9352-4459-9463-0c1181b2c489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.138183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] The token cache is being invalidate because project beb7a2da949a4e8190e7a75a8c54e9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:14.138315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.139306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.141683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1033/2026] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:13 2022] DELETE /identity/v3/projects/beb7a2da949a4e8190e7a75a8c54e9f4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:14.145662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:14.163481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a80ba7-14cd-4bc6-b938-0f5c1af8cea9 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:14.289343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:14.291004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.292811 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.295521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] PATH_INFO: `/v3/users/fd91b7fbf92f4f379679107decde551b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.297729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd91b7fbf92f4f379679107decde551b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:14.301229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:14.319649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:14.396424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd91b7fbf92f4f379679107decde551b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.406624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd91b7fbf92f4f379679107decde551b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.416531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:14.418377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:14.426608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd91b7fbf92f4f379679107decde551b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.427803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd91b7fbf92f4f379679107decde551b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.436482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac472d-9352-4459-9463-0c1181b2c489 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:14.442612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-26cde3db-2679-43bb-b6f8-cd5d17415344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd91b7fbf92f4f379679107decde551b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.443073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:14.444172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.444524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.445698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] PATH_INFO: `/v3/users/05ed31585b8342b7b48fd9ac196837c0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.447145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ed31585b8342b7b48fd9ac196837c0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:14.449476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:14.457666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 994/2027] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:14 2022] DELETE /identity/v3/users/fd91b7fbf92f4f379679107decde551b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:14.529323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ed31585b8342b7b48fd9ac196837c0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.552547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ed31585b8342b7b48fd9ac196837c0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.562562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ed31585b8342b7b48fd9ac196837c0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.563559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ed31585b8342b7b48fd9ac196837c0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.575082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ed31585b8342b7b48fd9ac196837c0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:14.593929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1034/2028] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:14 2022] DELETE /identity/v3/users/05ed31585b8342b7b48fd9ac196837c0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:14.599614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.605138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.605826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.645990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:14.647518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:14.766444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 995/2029] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:14.781394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:14.788103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:14.852584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:14.855874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:14.909088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9107a4-376a-4f0c-a69f-456967df0a09 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:14.912126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a290f0-4ff1-442f-a52c-bb415d423ee9 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:14.917867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:14.918538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:14.918851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.919206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.919612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.920098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:14.920396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:14.920788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] PATH_INFO: `/v3/projects/98186fc3a8a949f9a3037a17c96308bd` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:14.926533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98186fc3a8a949f9a3037a17c96308bd)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:14.929809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:14.934751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:14.936228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d7d81-95a5-4830-bf17-ae4d35503233 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:14.949396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1035/2030] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:14.999014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98186fc3a8a949f9a3037a17c96308bd', 'request_id': 'req-f1848273-8d0a-4c80-b700-fe5c95de0260'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.008321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98186fc3a8a949f9a3037a17c96308bd', 'request_id': 'req-f1848273-8d0a-4c80-b700-fe5c95de0260'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.018582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98186fc3a8a949f9a3037a17c96308bd', 'request_id': 'req-f1848273-8d0a-4c80-b700-fe5c95de0260'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.031413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] The token cache is being invalidate because project 98186fc3a8a949f9a3037a17c96308bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:15.031782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.032717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f1848273-8d0a-4c80-b700-fe5c95de0260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.035024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 996/2031] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:14 2022] DELETE /identity/v3/projects/98186fc3a8a949f9a3037a17c96308bd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:15.040611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.041233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.041233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.068477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:15.071567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.112574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:15.165442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1036/2032] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:15.173841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.174411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.174411 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.197018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:15.198880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.210213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 997/2033] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:15.215137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.227149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db91dc5-d645-4ff3-a683-a2f174da4dfe None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.233747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.234628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.235017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.235426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.236268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:15.236802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.238618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.253158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1037/2034] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:15.258187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.269550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51780d-afcb-42b2-9c03-0a09c61947f2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.277465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.279296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.279913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.280216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.281270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.283975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.290790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:15.327266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 998/2035] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:15 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:15.334856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.336510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.338541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.350142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c65d59-fb26-434e-94f3-5e7a16051671 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.458494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dc342-3441-4ec4-a4ac-8eaeae6e2ada admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.466060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.466231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.466778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.467066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.467315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.467444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.467868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.468142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] PATH_INFO: `/v3/projects/faf38ff592ed46b7b0848af1f26e3277` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.469359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf38ff592ed46b7b0848af1f26e3277)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.470332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.471577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.473720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.512718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1038/2036] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:15 2022] POST /identity/v3/users => generated 282 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:15.517411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.534465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf38ff592ed46b7b0848af1f26e3277', 'request_id': 'req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.537161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2f01e-ca5a-4b38-a105-86b777ed5a25 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.547208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf38ff592ed46b7b0848af1f26e3277', 'request_id': 'req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.571067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf38ff592ed46b7b0848af1f26e3277', 'request_id': 'req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.587208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] The token cache is being invalidate because project faf38ff592ed46b7b0848af1f26e3277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:15.587590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.588443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.590453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 999/2037] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:15 2022] DELETE /identity/v3/projects/faf38ff592ed46b7b0848af1f26e3277 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:15.591154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.593074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.633638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.634393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.634771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.635068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.635948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.637829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.649262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1039/2038] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:15.650119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.652055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.665651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2219-cbf1-4955-a1ef-b1f611d57e3e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.672995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.673164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f37ba-7e75-4122-943e-0ef7d6e61b9d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.673266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.673266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.673266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] PATH_INFO: `/v3/users/39fbb72e5b1344d593716f5c83f9943a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.674239 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fbb72e5b1344d593716f5c83f9943a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.676292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.677248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.678218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.678606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.678963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] PATH_INFO: `/v3/users/94e8cf92aae044c0bc25718a1f6b42ef` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.680533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e8cf92aae044c0bc25718a1f6b42ef)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.682878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:15.701904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:15.735084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:15.749553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fbb72e5b1344d593716f5c83f9943a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.752921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e8cf92aae044c0bc25718a1f6b42ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.761594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e8cf92aae044c0bc25718a1f6b42ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.771427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fbb72e5b1344d593716f5c83f9943a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.779816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e8cf92aae044c0bc25718a1f6b42ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.780664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fbb72e5b1344d593716f5c83f9943a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.783786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fbb72e5b1344d593716f5c83f9943a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.783906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e8cf92aae044c0bc25718a1f6b42ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.797330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-484a051f-39d0-4dc9-879a-2e2b47565f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e8cf92aae044c0bc25718a1f6b42ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.799663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fbb72e5b1344d593716f5c83f9943a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:15.811411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1040/2039] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:15 2022] DELETE /identity/v3/users/39fbb72e5b1344d593716f5c83f9943a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:15.811411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.811991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.813418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1000/2040] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:15 2022] DELETE /identity/v3/users/94e8cf92aae044c0bc25718a1f6b42ef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:15.817978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec53b-0992-4235-a200-4a216987377b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.818279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec53b-0992-4235-a200-4a216987377b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.818583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ec53b-0992-4235-a200-4a216987377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.839015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-011ec53b-0992-4235-a200-4a216987377b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:15.840218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-011ec53b-0992-4235-a200-4a216987377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.903493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc39e1-7b67-4476-bb1e-feffaddae616 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:15.922892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1001/2041] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:15.939177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec53b-0992-4235-a200-4a216987377b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:15.941098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-011ec53b-0992-4235-a200-4a216987377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:15.986439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:15.987930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:15.988048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:15.988386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:15.989125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:15.991219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.008828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1041/2042] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:16.010702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:16.024061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96574d-e811-4862-b748-46225af620b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.031859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:16.032907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.033194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.033455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] PATH_INFO: `/v3/projects/55882f57839343e69724f5c3cf5c1b08/users/24341451c5df4c1791fc97ee0bee7ee9/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.051025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ec53b-0992-4235-a200-4a216987377b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.055149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55882f57839343e69724f5c3cf5c1b08, user_id=24341451c5df4c1791fc97ee0bee7ee9, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:16.056386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:16.057056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.057344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.057615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.058869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dfc16-8bd9-4a1d-88c1-6db57dc2cdb5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.067991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:16.069701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.077944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1042/2043] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:16 2022] PUT /identity/v3/projects/55882f57839343e69724f5c3cf5c1b08/users/24341451c5df4c1791fc97ee0bee7ee9/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:16.080430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1002/2044] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:16.088261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.088569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.088863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.124120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] MFA Rules not processed for user `24341451c5df4c1791fc97ee0bee7ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:16.125812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:16.167855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:16.228949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:16.230577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:16.251733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df61a7-d903-44b7-9bf1-af8d847eca92 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.260612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1043/2045] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:16.276965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:16.297183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:16.335564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:16.336106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.336296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.336580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] PATH_INFO: `/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.337994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8043a63f2a4aa99a6dbd98cd015bcf)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:16.341377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.435941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48165-0884-4716-8df6-e3f11e950f12 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.448257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8043a63f2a4aa99a6dbd98cd015bcf', 'request_id': 'req-03a6d211-b72d-44b6-be47-4f1311de19ae'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.464233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8043a63f2a4aa99a6dbd98cd015bcf', 'request_id': 'req-03a6d211-b72d-44b6-be47-4f1311de19ae'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.488437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8043a63f2a4aa99a6dbd98cd015bcf', 'request_id': 'req-03a6d211-b72d-44b6-be47-4f1311de19ae'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.517920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] The token cache is being invalidate because project 9a8043a63f2a4aa99a6dbd98cd015bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:16.518511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.519530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.521332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1003/2046] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:16 2022] DELETE /identity/v3/projects/9a8043a63f2a4aa99a6dbd98cd015bcf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:16.522480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:16.524516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:16.569690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:16.570593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.571009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.571412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.572662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:16.575073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaeeb0-2cae-4466-9374-a1bed85ed001 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.632891 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6d211-b72d-44b6-be47-4f1311de19ae admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.643422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1044/2047] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:16 2022] POST /identity/v3/projects => generated 363 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:16.654254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.654254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.654487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.691584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:16.695303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:16.777298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:16.780360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:16.780754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:16.784156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] PATH_INFO: `/v3/projects/495456d6a9fb4a6288c839c2b14eb656` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:16.788544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495456d6a9fb4a6288c839c2b14eb656)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:16.791034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:16.839778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:16.856586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:16.885527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1045/2048] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:16.887607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:16.895674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:16.930421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709ce11-0a0e-4ee2-9cd4-27938d64d85a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:16.942373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495456d6a9fb4a6288c839c2b14eb656', 'request_id': 'req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.960588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495456d6a9fb4a6288c839c2b14eb656', 'request_id': 'req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:16.969976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495456d6a9fb4a6288c839c2b14eb656', 'request_id': 'req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.013988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] The token cache is being invalidate because project 495456d6a9fb4a6288c839c2b14eb656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:17.014340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.015058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-95d98a1f-b9d1-43af-b8ea-fe19ac7e2627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.016774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1004/2049] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:16 2022] DELETE /identity/v3/projects/495456d6a9fb4a6288c839c2b14eb656 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:17.021232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.021531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.021966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.024488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.024830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.025240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.025706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.026760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.029000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.044938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:17.046235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.055952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1046/2050] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:16 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:17.055952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.057573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.057952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1005/2051] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:17.058840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.060139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.070342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c7c97-c077-4072-b056-6975a2d82b2a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.072536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d363f6-6f10-4e9c-966e-1477f522672f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.075745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.076734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.077110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.077456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] PATH_INFO: `/v3/users/44a73ecc598a4b17ad654641bf4a4dd2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.077969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.078729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.078833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a73ecc598a4b17ad654641bf4a4dd2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.079144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.079642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.080384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.080998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.082115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.093380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1006/2052] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:17.094216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.105349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acde03c-7c0c-4168-ac45-c1bf87bca2ca admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.110088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.110827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.111117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.111418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.112198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:17.112461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.114056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.126833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1007/2053] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:17.130977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.131945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a73ecc598a4b17ad654641bf4a4dd2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.141504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68403050-5fe8-4bdd-b72c-eec4db062935 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.146540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.146946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a73ecc598a4b17ad654641bf4a4dd2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.147969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.148253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.148532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] PATH_INFO: `/v3/projects/ba369a8e75624d21a571306fcb3eb07f/users/62e13185f36f4458a0b9365f49ed374d/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.154208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a73ecc598a4b17ad654641bf4a4dd2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.155069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a73ecc598a4b17ad654641bf4a4dd2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.164127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a73ecc598a4b17ad654641bf4a4dd2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:17.164591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba369a8e75624d21a571306fcb3eb07f, user_id=62e13185f36f4458a0b9365f49ed374d, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.167261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.174700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1047/2054] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:17 2022] DELETE /identity/v3/users/44a73ecc598a4b17ad654641bf4a4dd2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:17.175356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.177044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.184732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1008/2055] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:17 2022] PUT /identity/v3/projects/ba369a8e75624d21a571306fcb3eb07f/users/62e13185f36f4458a0b9365f49ed374d/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:17.188495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.190681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.271256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369e1f-8ad5-49f3-be81-4b00b66cfc29 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.277811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.278355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bf781-865a-4601-9f8c-e23956a3cf87 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.278833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.279295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.279617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.280571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.283730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.284336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.286408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.286888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.287393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.288293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.288752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:17.292801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.323427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1009/2056] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:17.328929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.338456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1048/2057] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:17 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:17.340874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.350588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3dd3c-2dd7-484b-abf5-69bbe1846cac admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.449663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:17.477217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.479671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.480581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.481794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] PATH_INFO: `/v3/projects/ba369a8e75624d21a571306fcb3eb07f/users/62e13185f36f4458a0b9365f49ed374d/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.484784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba369a8e75624d21a571306fcb3eb07f, user_id=62e13185f36f4458a0b9365f49ed374d, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.488588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438c568-22ec-443e-8cdd-c75b5230b8c6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.492376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d984fc-bd11-482b-9344-63c73e43a020 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.503874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.505354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1010/2058] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:17 2022] PUT /identity/v3/projects/ba369a8e75624d21a571306fcb3eb07f/users/62e13185f36f4458a0b9365f49ed374d/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:17.506151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.506509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.510917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.511636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.513801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.517521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.518232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.518669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.558637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1049/2059] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:17 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:17.561943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.585360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffae38-c6b6-45ff-bd49-6e2eac0080b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.607207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] MFA Rules not processed for user `62e13185f36f4458a0b9365f49ed374d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:17.608695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.716846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.717954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.718698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.719199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.720103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.722926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.739116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1050/2060] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:17.745293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.759775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884621-9fad-479c-8920-b18982550f6c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.764556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.765296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.765585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.765897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.766631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.768271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.773473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1011/2061] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:17.780490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1051/2062] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:17.784337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.788840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.791053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.795749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec67f4-ffdd-4a9a-ae68-aadf73aee356 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.800945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.802305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.803698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.804859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] PATH_INFO: `/v3/projects/e170f7ba3ef04dc99a28681219e19347/users/dffdd263a68141b2b6043ddef692f199/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.843611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e170f7ba3ef04dc99a28681219e19347, user_id=dffdd263a68141b2b6043ddef692f199, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.848060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:17.871292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1012/2063] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:17 2022] PUT /identity/v3/projects/e170f7ba3ef04dc99a28681219e19347/users/dffdd263a68141b2b6043ddef692f199/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:17.876340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:17.879552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273aba-cd8b-4253-85fa-3de827a6fb10 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.879840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:17.899021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:17.952095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.952761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.953054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.953332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.964707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28ead-621d-43c6-8cb1-248e1212bcb8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:17.969837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:17.970712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:17.971007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:17.971296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] PATH_INFO: `/v3/projects/1321f85f0cf0468596717e29864ee189` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:17.972514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1321f85f0cf0468596717e29864ee189)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:17.974962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.028026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.029645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003e331-bf87-459e-8bd9-7c1a11369ca9 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.038549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:18.039965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1052/2064] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:18.041292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.041626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.041911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.062897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1321f85f0cf0468596717e29864ee189', 'request_id': 'req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:18.073255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] MFA Rules not processed for user `dffdd263a68141b2b6043ddef692f199`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:18.074496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.088009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1321f85f0cf0468596717e29864ee189', 'request_id': 'req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:18.110378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1321f85f0cf0468596717e29864ee189', 'request_id': 'req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:18.127195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] The token cache is being invalidate because project 1321f85f0cf0468596717e29864ee189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:18.127554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:18.128353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6cbade8d-c1c9-4605-8553-5b9b2d6516e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:18.130332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1013/2065] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:17 2022] DELETE /identity/v3/projects/1321f85f0cf0468596717e29864ee189 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:18.136462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.136771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.137093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.173713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:18.175257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.195155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1053/2066] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:18.196880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.200204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.279860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfbaff-5077-40a4-8c4c-0412d1607b73 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.285140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.285873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.286229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.286620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.289049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.295401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1014/2067] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:18.295401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.295401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.302060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:18.308018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d57900-4d34-42be-aa25-8c0c310830e2 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.313747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.314538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.314820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.315098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.315821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.317725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0bb42-0b32-4aba-89f3-e3d10214b2ae admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.356054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1015/2068] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:18.357390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.357787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.358148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.370380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.372192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.379234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:18.380809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.382242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1054/2069] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:18.382895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.395656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a432-f25c-4df5-97f8-e06efba2c9b5 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.465750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1016/2070] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:18.470372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.482302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ba0ae-b2db-4510-9eab-129f6b39d8bd None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.487174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.487965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.488317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.488663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.489461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:18.489770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.491907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.500831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.501507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.501907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.502186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.503025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.505098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.507340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1017/2071] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:18.518102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.531396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f985f-0487-4948-a9cb-bda8a174a23e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.536949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.538293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.538657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.538901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.539086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1055/2072] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:18.539754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.542274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.544546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.561119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d7a13-a8ba-4d14-907f-1cafc82d8575 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.566823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.567634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.567896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.568684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.569821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.571726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.582962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1018/2073] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:18.583141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1056/2074] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:18.584775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.586486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.596268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b2d52-2eab-494c-81b8-5cf1832d77a9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.603718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:18.655991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58df6d-1b11-46ac-86ad-3b91afbee3b8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.661356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.663915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.664234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.664445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.665436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.668246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.674267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.675541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.676100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.676660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.678506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.680945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.691749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1019/2075] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:18.692604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1057/2076] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:18.697256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.698535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.709752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92949335-4bb3-4a8e-adc6-ed649fce9a36 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.711301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379dedc-072b-499b-b2a4-813b4a7051e9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.716076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.716542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.717007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.717209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.717310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.717493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.717591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] PATH_INFO: `/v3/projects/2a41549be6da477b88b3c2e6bd0a5fb1/users/0a2e6ac0e3b44f928cd712897b0f2542/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.717772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.718504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.720165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.732772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1058/2077] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:18.736630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.751872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a41549be6da477b88b3c2e6bd0a5fb1, user_id=0a2e6ac0e3b44f928cd712897b0f2542, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.757011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4568b-ae29-47d3-8678-4bddbb659a06 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.766899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17676a89-2184-4bad-adbc-18af38d12a5d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.780542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.781042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.781330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.781607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.782804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.784892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.799084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1020/2078] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:18 2022] PUT /identity/v3/projects/2a41549be6da477b88b3c2e6bd0a5fb1/users/0a2e6ac0e3b44f928cd712897b0f2542/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:18.801342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.801638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.801917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.810248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1059/2079] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:18.814365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.826012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:18.835419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb9a22-e5e8-4366-a370-408b0f634d80 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.849008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] MFA Rules not processed for user `0a2e6ac0e3b44f928cd712897b0f2542`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:18.850366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:18.906188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:18.907388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.907847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.908267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] PATH_INFO: `/v3/projects/3a985e05b5fa4d5f955b357791efc32f/users/ce616d4cb1d0463cab5b85a0b3ce72ff/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:18.923274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1021/2080] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:18.928247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a985e05b5fa4d5f955b357791efc32f, user_id=ce616d4cb1d0463cab5b85a0b3ce72ff, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:18.928678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:18.932004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500b0fb-f7ad-4bec-bf56-ae6e8b164392 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:18.947684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9efee-e330-4d8c-b224-674d0cb44fc6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:18.959892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1060/2081] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:18 2022] PUT /identity/v3/projects/3a985e05b5fa4d5f955b357791efc32f/users/ce616d4cb1d0463cab5b85a0b3ce72ff/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:18.973451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:18.973844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:18.974075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.010229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] MFA Rules not processed for user `ce616d4cb1d0463cab5b85a0b3ce72ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:19.012305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:19.073065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.073829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.074123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.074404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.075155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.077425 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.100919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:19.114037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1061/2082] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:19.119160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.123258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1022/2083] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:18 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:19.124329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.131524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed96573-a790-448d-8f1c-5c53d970d04f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.193685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a938-8eaa-49f2-b17d-3152fed40200 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.198066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.198854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.199084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.199268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.199635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.199780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.200067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.200364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.200622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.201056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.202672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.203168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.225454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1023/2084] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:19 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:19.229266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.230812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:19.240424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17133fe0-8667-4782-9011-27d1eea60564 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.242659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1062/2085] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:19 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:19.244403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.306765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.307545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.307837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.308141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.309621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.312098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.324574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1edbd-d577-43ea-a812-fa32f3e6b219 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.325874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1024/2086] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:19.330011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.332516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.334273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.335137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.335461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.336379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.338420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.340763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486d27-02b3-440c-af9a-d1e3581a3d03 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.345566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.346561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.346856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.347138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] PATH_INFO: `/v3/projects/2f19819b818645719bb6effda086e5f1/users/9dc560741a8f49a1abbd73fc48e252e8/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.363400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1063/2087] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:19 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:19.366205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.367420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f19819b818645719bb6effda086e5f1, user_id=9dc560741a8f49a1abbd73fc48e252e8, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.370164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.378538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4c67-0053-450a-baa7-e133003ff004 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.385208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1025/2088] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:19 2022] PUT /identity/v3/projects/2f19819b818645719bb6effda086e5f1/users/9dc560741a8f49a1abbd73fc48e252e8/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:19.395190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.447718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.448403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.448688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.448969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.449713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.451291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.465950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1064/2089] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:19.466161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:19.467331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.468539 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ba35-f088-4775-afd4-c26ccc0ddb2a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.474894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.476161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.476493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.476777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.477515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.479175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.479394 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad4d4e-0cdd-4630-a250-5b618917bde4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.485146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.486035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.486325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.486603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] PATH_INFO: `/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0/users/ee2723edddda4f51841e5b3e583bed8d/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.491535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1026/2090] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:19.494210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.502367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a21884cb31462fb8ee0a3feabf95a0, user_id=ee2723edddda4f51841e5b3e583bed8d, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.505600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.510109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7e5f9-46a3-47b3-b055-d1b70e38d2de admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.515984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.516883 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.517168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.517442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] PATH_INFO: `/v3/projects/2f19819b818645719bb6effda086e5f1/users/9dc560741a8f49a1abbd73fc48e252e8/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.519535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f19819b818645719bb6effda086e5f1, user_id=9dc560741a8f49a1abbd73fc48e252e8, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.523249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff156d89-6acb-4531-a72e-fde63b03e858 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.523748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1065/2091] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:19 2022] PUT /identity/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0/users/ee2723edddda4f51841e5b3e583bed8d/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:19.529958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.535894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1027/2092] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:19 2022] PUT /identity/v3/projects/2f19819b818645719bb6effda086e5f1/users/9dc560741a8f49a1abbd73fc48e252e8/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:19.549599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.549599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.549599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.587415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] MFA Rules not processed for user `9dc560741a8f49a1abbd73fc48e252e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:19.588759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:19.619895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407cb2d-b1d2-4e4b-b71a-9c3e45d96d54 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.627037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:19.726555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1028/2093] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:19.736084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.737647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.738486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.738875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.739254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.740916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.743513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.755195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1066/2094] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:19.761506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:19.776094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec278b-8a3c-40e1-8a2a-305fef1fcb45 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.789047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.790035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.790562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.790811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] PATH_INFO: `/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0/users/ee2723edddda4f51841e5b3e583bed8d/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.793085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a21884cb31462fb8ee0a3feabf95a0, user_id=ee2723edddda4f51841e5b3e583bed8d, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.795954 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee43de-a27a-4785-b3fb-8d14e798ded5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:19.825701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e402f8-529c-4e24-95df-c2998fe6d636 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:19.826577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1067/2095] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:19 2022] PUT /identity/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0/users/ee2723edddda4f51841e5b3e583bed8d/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:19.837553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.838440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.839295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.893026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:19.894147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:19.894958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:19.895349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] MFA Rules not processed for user `ee2723edddda4f51841e5b3e583bed8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:19.895755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:19.899054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:19.947280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:19.991933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:19.993419 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ed42-ecfa-4a69-ba2c-6055be1042a2 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:20.003789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1068/2096] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:20.012986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1029/2097] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:20.027395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:20.030166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:20.051207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111d4ec-f1f1-4da5-abd6-1cbff72345fd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:20.056877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:20.064272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.064695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.065136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.150822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:20.152286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed97ab-aea7-4d93-ac20-38511088fe55 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:20.167608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1069/2098] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:20.472057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.472931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.473387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.476407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1030/2099] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:29:20.505395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.505689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.505972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.538570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:20.540658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:20.555157 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:20.602740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:20.604818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:20.694105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1070/2100] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:20.716412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:20.718000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:20.718794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42731da1-8b52-425c-874c-7a0167abcc3f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:20.727378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:20.728610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.728926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.729307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] PATH_INFO: `/v3/users/cc2e086bc3464c0fbb6874185925924a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.730842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2e086bc3464c0fbb6874185925924a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:20.733477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:20.735869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb18b6-7a41-45a3-8b8c-53a37f20588a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:20.745096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:20.745772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.746096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.746528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.764823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:20.768758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:20.788644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1071/2101] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:20.799894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2e086bc3464c0fbb6874185925924a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:20.814835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2e086bc3464c0fbb6874185925924a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:20.876247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2e086bc3464c0fbb6874185925924a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:20.877073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2e086bc3464c0fbb6874185925924a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:20.887125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2e086bc3464c0fbb6874185925924a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:20.899473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1031/2102] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:20 2022] DELETE /identity/v3/users/cc2e086bc3464c0fbb6874185925924a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:20.907245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:20.917952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaa688-c987-4d63-a407-09de29a74505 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:20.971252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:20.971816 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:20.972214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:20.972558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:20.975481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.048069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.049524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291167ac-4cba-4e36-94c4-3f42ba4fb22d service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.061203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1072/2103] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:21.094454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.097764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.204468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:21.222973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd506ca-f79c-47dd-8d00-6dd147ee4b18 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.230548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.231601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.232012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.232297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] PATH_INFO: `/v3/projects/de649e3f744649f8961fbda682536115` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.233612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de649e3f744649f8961fbda682536115)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.235698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.307429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de649e3f744649f8961fbda682536115', 'request_id': 'req-e52178b6-fd49-4368-a2be-359d19312a3a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.315592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de649e3f744649f8961fbda682536115', 'request_id': 'req-e52178b6-fd49-4368-a2be-359d19312a3a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.324854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de649e3f744649f8961fbda682536115', 'request_id': 'req-e52178b6-fd49-4368-a2be-359d19312a3a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.337262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] The token cache is being invalidate because project de649e3f744649f8961fbda682536115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:21.337558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.338216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-e52178b6-fd49-4368-a2be-359d19312a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.339821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1032/2104] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:21 2022] DELETE /identity/v3/projects/de649e3f744649f8961fbda682536115 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:21.344738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.345204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.345789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.367500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:21.368720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.458356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:21.475587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1073/2105] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:21.485274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.486215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.486603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.507442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:21.508538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.518049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1033/2106] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:21.522411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.535123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812912a-badb-4ee1-9bd7-914d9079b5eb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.538465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.540053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.541354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.542054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.542322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.542609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.543351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:21.543723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.545333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.556360 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215fe0f-2f76-4c4c-80af-3fec58482378 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.559202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1074/2107] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:21.562966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.563465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.563879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.564161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.564530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] PATH_INFO: `/v3/users/24341451c5df4c1791fc97ee0bee7ee9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.565741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24341451c5df4c1791fc97ee0bee7ee9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.569115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.575392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f834a-7703-4f52-944e-ac9dcf602f89 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.581139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.582001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.582296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.582609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.583766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.586217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.620617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1075/2108] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:21.622670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24341451c5df4c1791fc97ee0bee7ee9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.624723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.631623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24341451c5df4c1791fc97ee0bee7ee9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.648451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24341451c5df4c1791fc97ee0bee7ee9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.649944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24341451c5df4c1791fc97ee0bee7ee9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.677068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7663f67d-355b-48fa-8f02-3e26f53061e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24341451c5df4c1791fc97ee0bee7ee9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:21.686471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1034/2109] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:21 2022] DELETE /identity/v3/users/24341451c5df4c1791fc97ee0bee7ee9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:21.692183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.692510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.692807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.714478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:21.715510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba826ee-597a-4119-894d-df15c3c011bd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.715953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.771426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:21.791688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.793293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.793293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.793293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.793859 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.795911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.801760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1035/2110] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:21.809127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.810689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.839404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1076/2111] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:21.842162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.844673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:21.857946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565e8ad-0c9e-4731-b03a-457c4d71bad7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.864556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.865236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.865519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.865797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.866578 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.868411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.876929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8d713-1ba2-4192-91ba-8b6953205d83 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.878580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1077/2112] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:21.883530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.885426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.886170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.886523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.887046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.893887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88b87-94cf-496f-b1ef-c88a5d273244 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.898145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.899705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.900059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.900733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.901018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.901295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.902027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.903636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f7f5d-311e-45e9-a6ac-a7029c9c0290 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.911919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1036/2113] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:21.918809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1078/2114] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:21.920126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:21.931150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabd7f6-81e9-4edd-9471-208f869346df service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:21.936036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:21.936968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.937275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.937549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] PATH_INFO: `/v3/projects/b3669b4153434e93aa29b772cfd78ea4/users/bf8e812b72a3456dbb303f0498b44334/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:21.953687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3669b4153434e93aa29b772cfd78ea4, user_id=bf8e812b72a3456dbb303f0498b44334, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:21.956550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:21.983754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1037/2115] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:21 2022] PUT /identity/v3/projects/b3669b4153434e93aa29b772cfd78ea4/users/bf8e812b72a3456dbb303f0498b44334/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:21.983888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:21.983888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:21.983888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:22.006638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:22.008225 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:22.042879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:22.080862 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1079/2116] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:22.092683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:22.095020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:22.181196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fab7f-8eaf-4b7c-bd10-263343e1f8e1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:22.185179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:22.185839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:22.186284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:22.186566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:22.198175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:22.199692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:22.210440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1038/2117] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:22.251440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:22.252932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:22.290832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815f030-a41f-453f-8d0d-04f646f9b488 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:22.307015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:22.308256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:22.308630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:22.308975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] PATH_INFO: `/v3/projects/55882f57839343e69724f5c3cf5c1b08` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:22.312150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55882f57839343e69724f5c3cf5c1b08)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:22.314076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:22.439903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55882f57839343e69724f5c3cf5c1b08', 'request_id': 'req-f61050ac-1fc5-4661-bbf9-5def2b080121'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.447068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55882f57839343e69724f5c3cf5c1b08', 'request_id': 'req-f61050ac-1fc5-4661-bbf9-5def2b080121'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.454830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55882f57839343e69724f5c3cf5c1b08', 'request_id': 'req-f61050ac-1fc5-4661-bbf9-5def2b080121'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.482626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] The token cache is being invalidate because project 55882f57839343e69724f5c3cf5c1b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:22.482922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.483640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.485700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1080/2118] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:22 2022] DELETE /identity/v3/projects/55882f57839343e69724f5c3cf5c1b08 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:22.490312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:22.502503 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef45630-80be-4a8f-a457-a2da6821fcd2 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:22.575649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:22.576574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:22.576854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:22.577125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] PATH_INFO: `/v3/users/62e13185f36f4458a0b9365f49ed374d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:22.578359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e13185f36f4458a0b9365f49ed374d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:22.580386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:22.592196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:22.634335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e13185f36f4458a0b9365f49ed374d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.642212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e13185f36f4458a0b9365f49ed374d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.668816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e13185f36f4458a0b9365f49ed374d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.669567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e13185f36f4458a0b9365f49ed374d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.679024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e13185f36f4458a0b9365f49ed374d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:22.688704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1039/2119] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:22 2022] DELETE /identity/v3/users/62e13185f36f4458a0b9365f49ed374d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:22.797512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:22.799232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:22.819934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61050ac-1fc5-4661-bbf9-5def2b080121 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:22.896088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:22.897271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:22.897742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:22.898226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] PATH_INFO: `/v3/users/ce616d4cb1d0463cab5b85a0b3ce72ff` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:22.899232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce616d4cb1d0463cab5b85a0b3ce72ff)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:22.901205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:22.977948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce616d4cb1d0463cab5b85a0b3ce72ff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.003301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.004956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:23.006108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.014403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce616d4cb1d0463cab5b85a0b3ce72ff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.027515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce616d4cb1d0463cab5b85a0b3ce72ff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.029235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce616d4cb1d0463cab5b85a0b3ce72ff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.037023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4624333-9f6c-4f78-9579-ebaadd07b3e1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.044769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.045826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.046153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.046487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] PATH_INFO: `/v3/projects/ba369a8e75624d21a571306fcb3eb07f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.047787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba369a8e75624d21a571306fcb3eb07f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.048107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e1a10a4c-60f6-4634-b274-757c2751803c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce616d4cb1d0463cab5b85a0b3ce72ff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.049729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.058255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1081/2120] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:22 2022] DELETE /identity/v3/users/ce616d4cb1d0463cab5b85a0b3ce72ff => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:23.063187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.063693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.063979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.096857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:23.107533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.118724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba369a8e75624d21a571306fcb3eb07f', 'request_id': 'req-d7b50c96-9435-4d65-9624-22fc78629654'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.130662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba369a8e75624d21a571306fcb3eb07f', 'request_id': 'req-d7b50c96-9435-4d65-9624-22fc78629654'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.138919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba369a8e75624d21a571306fcb3eb07f', 'request_id': 'req-d7b50c96-9435-4d65-9624-22fc78629654'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.154801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] The token cache is being invalidate because project ba369a8e75624d21a571306fcb3eb07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:23.155123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.155862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7b50c96-9435-4d65-9624-22fc78629654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.162534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1040/2121] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:23 2022] DELETE /identity/v3/projects/ba369a8e75624d21a571306fcb3eb07f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:23.164445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49a40-8d78-44a8-ab24-603847e2bf42 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.164585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49a40-8d78-44a8-ab24-603847e2bf42 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.165001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49a40-8d78-44a8-ab24-603847e2bf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.181353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1082/2122] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:23.191997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.193929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.194522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-89e49a40-8d78-44a8-ab24-603847e2bf42 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:23.195968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-89e49a40-8d78-44a8-ab24-603847e2bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.211511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1041/2123] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:23.220104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.220476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.220829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.250795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:23.252311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.262003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1042/2124] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:23.262563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11fdc1-c49f-428d-934f-9ef73cfff61d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.266499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.266809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.267567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.268127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.268481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.277255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bf04-ecae-4631-9c39-a00e807f0880 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.280479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.282463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.282628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.283275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.283631 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.283915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.284653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:23.285050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.286676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.296633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1083/2125] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:23.316145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.316420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1043/2126] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:23.328598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24998-6615-4412-8bc9-4c57a80b3b86 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.335208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.336078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.336510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.336647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.337489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.339819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.384447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1084/2127] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:23.389515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.415015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbee58-e0b0-48e9-a781-7857043ff351 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.473817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:23.509518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.511997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.512438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.513038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.514022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.517235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.578073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1044/2128] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:23.580760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.601713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d68dc-22de-47e3-82cd-60d8afa56b40 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.617640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.620266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.620563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.622120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.624740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.626697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.667666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.678546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1085/2129] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:23.690210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e0b2e-2d5a-4579-9683-ce8601d3724b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.702477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.703557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.704139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.705088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.705842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.707738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.731227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1045/2130] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:23.735061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.751003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.757627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa47c4-ab6e-4652-b985-d706bf5d2d2d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.759554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.769404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.770644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.770940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.771224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] PATH_INFO: `/v3/projects/2ad441ad4d3448b78363a2d7f29f8ea3/users/9cd3e1f4f1604e3f94a9779207a0c5ac/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.777888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4fd7f-b0ba-457f-84fc-4aae85b1c3f3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:23.789412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:23.791100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.792021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.792329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] PATH_INFO: `/v3/projects/3a985e05b5fa4d5f955b357791efc32f` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.794501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a985e05b5fa4d5f955b357791efc32f)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.797036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.797942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad441ad4d3448b78363a2d7f29f8ea3, user_id=9cd3e1f4f1604e3f94a9779207a0c5ac, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:23.813902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8287a28-8d63-4b4a-98cf-eac1690b8742 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:23.833867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1086/2131] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:23 2022] PUT /identity/v3/projects/2ad441ad4d3448b78363a2d7f29f8ea3/users/9cd3e1f4f1604e3f94a9779207a0c5ac/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:23.850180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:23.850366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:23.850659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:23.892915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] MFA Rules not processed for user `9cd3e1f4f1604e3f94a9779207a0c5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:23.894375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:23.897255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a985e05b5fa4d5f955b357791efc32f', 'request_id': 'req-424855bb-ed2e-4edd-a5fc-a467b709c67c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.909032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:23.913784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a985e05b5fa4d5f955b357791efc32f', 'request_id': 'req-424855bb-ed2e-4edd-a5fc-a467b709c67c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.931968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a985e05b5fa4d5f955b357791efc32f', 'request_id': 'req-424855bb-ed2e-4edd-a5fc-a467b709c67c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.955210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] The token cache is being invalidate because project 3a985e05b5fa4d5f955b357791efc32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:23.955859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.956550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:23.962247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1046/2132] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:23 2022] DELETE /identity/v3/projects/3a985e05b5fa4d5f955b357791efc32f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:23.964108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:23.965793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:24.029585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1087/2133] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:24.031119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.033694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:24.072706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424855bb-ed2e-4edd-a5fc-a467b709c67c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.079212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.080390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.082072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.082072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] PATH_INFO: `/v3/users/ee2723edddda4f51841e5b3e583bed8d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.083519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2723edddda4f51841e5b3e583bed8d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.086132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.139687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b02757-a5ec-428a-a9d9-e49a4daa9340 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.147095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.147903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.148230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.148656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.150074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.151663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.166173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2723edddda4f51841e5b3e583bed8d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.169422 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:24.181173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2723edddda4f51841e5b3e583bed8d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.194311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1088/2134] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:24 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:24.198138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.206575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2723edddda4f51841e5b3e583bed8d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.207574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2723edddda4f51841e5b3e583bed8d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.217744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2723edddda4f51841e5b3e583bed8d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.227426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1047/2135] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:23 2022] DELETE /identity/v3/users/ee2723edddda4f51841e5b3e583bed8d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:24.284583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3b319-6cbc-489c-b0d5-f7ecdbf6b032 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.393078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:24.410476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.411237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.411702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.413392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.413392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.415534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.462828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1089/2136] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:24 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:24.466443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.469637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:24.499937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561e90-829c-4bb5-b8a6-b439e0960a40 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.513758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.514497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.514731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.515007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.515780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.523461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.552834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1048/2137] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:24.555510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.568499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69533-0793-488f-bfbe-ed601224f1be admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.576797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.577711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.577991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.578268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] PATH_INFO: `/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3/users/aad9d17c519d43f9bba4ac8c794a76e5/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.614584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea2e4b0b2d74d4e90a000310cb760e3, user_id=aad9d17c519d43f9bba4ac8c794a76e5, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.618792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.653510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1090/2138] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:24 2022] PUT /identity/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3/users/aad9d17c519d43f9bba4ac8c794a76e5/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:24.657864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.671356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea0947-d7d3-4e2f-b489-f147d8daee3e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.702944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.704980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:24.775974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.777081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.777376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.777714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.778766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.781448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.793320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1049/2139] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:24.798478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:24.818159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d3462-f4c1-4e97-b1eb-357b8bd4cb6d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.821331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f316-8f2b-4a20-8b2a-c3c76c7cfe30 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:24.833000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.835268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:24.835528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.835920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.836211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] PATH_INFO: `/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.836380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.836654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.836941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] PATH_INFO: `/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3/users/aad9d17c519d43f9bba4ac8c794a76e5/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.837480 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a21884cb31462fb8ee0a3feabf95a0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.839543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea2e4b0b2d74d4e90a000310cb760e3, user_id=aad9d17c519d43f9bba4ac8c794a76e5, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:24.839660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.842288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329766b-82fa-49ce-9563-dab28cbdc7e4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:24.858066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1050/2140] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:24 2022] PUT /identity/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3/users/aad9d17c519d43f9bba4ac8c794a76e5/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:24.869205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.869492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.869775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:24.908358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a21884cb31462fb8ee0a3feabf95a0', 'request_id': 'req-58708b0b-b457-4e96-bb3f-c91375390f50'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.912925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] MFA Rules not processed for user `aad9d17c519d43f9bba4ac8c794a76e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:24.913642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:24.917378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a21884cb31462fb8ee0a3feabf95a0', 'request_id': 'req-58708b0b-b457-4e96-bb3f-c91375390f50'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.928472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a21884cb31462fb8ee0a3feabf95a0', 'request_id': 'req-58708b0b-b457-4e96-bb3f-c91375390f50'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.949330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] The token cache is being invalidate because project f7a21884cb31462fb8ee0a3feabf95a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:24.949701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.950753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58708b0b-b457-4e96-bb3f-c91375390f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:24.953075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1091/2141] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:24 2022] DELETE /identity/v3/projects/f7a21884cb31462fb8ee0a3feabf95a0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:24.961772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfeaa9-6327-4bc5-91fb-f33781b359e4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:24.962068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfeaa9-6327-4bc5-91fb-f33781b359e4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:24.963337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfeaa9-6327-4bc5-91fb-f33781b359e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.004338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-40cfeaa9-6327-4bc5-91fb-f33781b359e4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:25.006259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-40cfeaa9-6327-4bc5-91fb-f33781b359e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.029229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1051/2142] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:25.056328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:25.092585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.099932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1092/2143] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:25.100191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.101704 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.102016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.102303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.125207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:25.126504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.138717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1093/2144] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:25.143259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.152933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:25.158566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f3cfb-5d1f-4501-8c65-1e8a8c4b5608 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.165915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.166585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.166877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.167237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.168183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:25.168506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.170504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.187202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1094/2145] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:25.192020 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.207730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8742b-a351-4ea8-bc28-2900e4ddd342 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.214413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.215286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.216184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.216184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.216641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.219127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.222479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eeaf9-847a-452c-80b8-756a4487469b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.229380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.231833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.236668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.236845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.252700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.256582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.260608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1095/2146] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:25 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:25.268571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.274036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1052/2147] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:25.340074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.342076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.374118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f56c-de71-4764-a839-5643274ad5fc service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.439711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca9f4-30e1-49b6-84a4-77525c81cad5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.445972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.446719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.447008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.447289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.448082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.450261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.478750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1096/2148] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:25 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:25.483280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.492045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.493594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.494022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.494469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.496698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.497014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce67660-c470-47e5-ab07-d4bc2095807b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.502288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.504229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.504828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.506695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.507889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.509188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.521260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1097/2149] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:25.522089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.539753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33898c6-b698-4d51-bbce-8c21503e1868 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.545587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.546365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.546653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.546941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.548927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.591202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.594085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.608410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1053/2150] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:25.609459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.624071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba77e1d-c4d9-492d-a434-cf5edb40cd03 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.635538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.636396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.636692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.637313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.638117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.640676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.648679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.650139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46615a0-3037-47ee-ba65-c3afab2a4a6d service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.655249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1054/2151] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:25.662909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:25.680039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1098/2152] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:25.692878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb4e08-c90a-45ac-935c-94f516ba1e92 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:25.702358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:25.703529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.703913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.704686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] PATH_INFO: `/v3/projects/66584fa94e5d4da0bb2c441d13f0f240/users/c1c6b18b425944e7bf96a91df82774d4/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.745367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66584fa94e5d4da0bb2c441d13f0f240, user_id=c1c6b18b425944e7bf96a91df82774d4, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:25.749832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:25.777453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1055/2153] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:25 2022] PUT /identity/v3/projects/66584fa94e5d4da0bb2c441d13f0f240/users/c1c6b18b425944e7bf96a91df82774d4/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:25.791011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:25.792009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:25.792408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:25.867063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] MFA Rules not processed for user `c1c6b18b425944e7bf96a91df82774d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:25.871506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:25.883209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:26.039282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1099/2154] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:26.054121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:26.057134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:26.158613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:26.191192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39b03-10b7-490e-bfb2-fdcd8d90e158 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:26.200709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:26.201397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:26.201683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:26.201976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:26.222075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:26.223739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248ea84-42db-42c4-909a-32538003e73a service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:26.237289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1056/2155] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:27.882732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:27.957150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c34d25-9890-4974-a257-ad291a9e6c91 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:27.961872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:27.962611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:27.962905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:27.963269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:27.968271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:28.096847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:28.098514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:28.138404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1100/2156] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:28.262604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:28.263104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:28.263210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:28.319860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] MFA Rules not processed for user `bf8e812b72a3456dbb303f0498b44334`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:28.321963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:28.422471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1057/2157] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:28.438890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:28.441410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:28.574372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:28.594863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d47b5-c3d0-4a88-b19a-5c3a2b402353 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:28.601126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:28.601968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:28.602362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:28.602746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:28.614636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:28.616453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892aad2-b035-416d-bad8-e268bdb671b1 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:28.632479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1101/2158] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:30.179516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:30.181525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:30.343721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb86a4-8292-43e3-9b13-f7866cbc9b9e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:30.351142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:30.352547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:30.353276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:30.353765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] PATH_INFO: `/v3/users/ac93ded98e7546679f4c640a5d4642fb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:30.355348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac93ded98e7546679f4c640a5d4642fb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:30.357997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:30.546911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac93ded98e7546679f4c640a5d4642fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:30.564691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac93ded98e7546679f4c640a5d4642fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:30.617150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac93ded98e7546679f4c640a5d4642fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:30.618910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac93ded98e7546679f4c640a5d4642fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:30.629260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:30.647966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac93ded98e7546679f4c640a5d4642fb'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:30.661717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1058/2159] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:30 2022] DELETE /identity/v3/users/ac93ded98e7546679f4c640a5d4642fb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:30.666793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfdf2-6323-45eb-a20a-0cccceb316ac None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:30.667569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfdf2-6323-45eb-a20a-0cccceb316ac None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:30.667932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcfdf2-6323-45eb-a20a-0cccceb316ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:30.708043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b3dcfdf2-6323-45eb-a20a-0cccceb316ac None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:30.709401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b3dcfdf2-6323-45eb-a20a-0cccceb316ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:30.811958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1102/2160] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:30.839740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:30.842195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:30.961680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b9d36-f950-4f8e-acd2-2159367fa978 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:30.980018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:30.980830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:30.981257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:30.981526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:31.006997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:31.006997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:31.066184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1059/2161] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:31.252284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6510-7438-475f-aa9d-bee550e006f2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:31.252557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6510-7438-475f-aa9d-bee550e006f2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:31.252842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c6510-7438-475f-aa9d-bee550e006f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:31.304535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ab7c6510-7438-475f-aa9d-bee550e006f2 None None] MFA Rules not processed for user `bf8e812b72a3456dbb303f0498b44334`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:31.307267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ab7c6510-7438-475f-aa9d-bee550e006f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:31.437174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1103/2162] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:31.469898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:31.471461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:31.488936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bb58-3bb1-465a-a8a7-aa5c95165d86 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:31.503989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:31.509013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:31.509349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:31.509550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] PATH_INFO: `/v3/users/dffdd263a68141b2b6043ddef692f199` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:31.510863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffdd263a68141b2b6043ddef692f199)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:31.512862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:31.593443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffdd263a68141b2b6043ddef692f199'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:31.603716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffdd263a68141b2b6043ddef692f199'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:31.627947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffdd263a68141b2b6043ddef692f199'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:31.629448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffdd263a68141b2b6043ddef692f199'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:31.654089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffdd263a68141b2b6043ddef692f199'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:31.670613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1060/2163] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:31 2022] DELETE /identity/v3/users/dffdd263a68141b2b6043ddef692f199 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:31.676279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:31.676775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:31.676892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:31.683511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:31.697715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:31.731779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:31.733018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:31.877936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b92c04-4c3b-40e1-80e1-faaf8d2a1a2c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:31.890416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1104/2164] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:31.894991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:31.897247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:31.898571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:31.899348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] PATH_INFO: `/v3/projects/f85f6442a47b49e0bad2d5be50da4ba5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:31.902919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85f6442a47b49e0bad2d5be50da4ba5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:31.903971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:31.906363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:31.907225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:31.929007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:32.020996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:32.065856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85f6442a47b49e0bad2d5be50da4ba5', 'request_id': 'req-bd0d97cd-1020-44a0-aa7c-918686c62466'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:32.085785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85f6442a47b49e0bad2d5be50da4ba5', 'request_id': 'req-bd0d97cd-1020-44a0-aa7c-918686c62466'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:32.101009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85f6442a47b49e0bad2d5be50da4ba5', 'request_id': 'req-bd0d97cd-1020-44a0-aa7c-918686c62466'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:32.136841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f21e4-5649-425c-8e86-48f9402ecd57 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.141217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] The token cache is being invalidate because project f85f6442a47b49e0bad2d5be50da4ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:32.141576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:32.146944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-bd0d97cd-1020-44a0-aa7c-918686c62466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:32.152144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1061/2165] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:31 2022] DELETE /identity/v3/projects/f85f6442a47b49e0bad2d5be50da4ba5 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:32.160741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d600-bf19-4dc9-baae-1f0828dc7136 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.162381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d600-bf19-4dc9-baae-1f0828dc7136 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.162731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d600-bf19-4dc9-baae-1f0828dc7136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.224745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b670d600-bf19-4dc9-baae-1f0828dc7136 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:32.229017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b670d600-bf19-4dc9-baae-1f0828dc7136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:32.288092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.288796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.289108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.289449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.291606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:32.361242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1062/2166] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:32.367980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.369702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.370091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.370466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.372915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.388473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1105/2167] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:32.403480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:32.405149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:32.418309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1063/2168] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:32.421972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.438682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c826c-5fef-4050-8cd0-d4ccf9f62c74 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.447670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.448550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.449015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.449771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.450953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:32.451149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.457711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.505114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1106/2169] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:32.510467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.547862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e52a7-df4c-42fb-8671-5c0a01b2c0d8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.577934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.579542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.580011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.580328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.582510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.591418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.695628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1064/2170] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:32 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:32.696965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.714026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be44bc5-2024-4f01-bdfe-32c6608fe163 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.842898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.843322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.844339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.844798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.846235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.852631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.884644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.893333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1107/2171] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:32 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:32.894410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.899600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f40f0-14fc-4904-9f05-f82e8edb24e5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.900644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:32.914320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.915014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.915593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.915931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.917029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.918493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.936466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1065/2172] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:32.937146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.950274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e01c3-ecab-49a0-8ab0-8fbe64331847 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.951577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ac174-09d8-4d19-9d33-32e4f2c7484c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:32.958934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.959723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.960008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.960281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.961306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.963209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.975283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:32.976535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:32.977011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:32.977476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] PATH_INFO: `/v3/projects/e170f7ba3ef04dc99a28681219e19347` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:32.978947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e170f7ba3ef04dc99a28681219e19347)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:32.981126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:32.983828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1066/2173] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:32.985764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:32.992011 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:33.001846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68176df-6952-4071-ae3d-d605de4a9f0f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.014372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.019877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.020249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.020613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] PATH_INFO: `/v3/projects/2bcde2ec5e1546f9986ded050c6c1f40/users/54a030cfcfe74cc6927f4c087b58d0c2/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.046610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcde2ec5e1546f9986ded050c6c1f40, user_id=54a030cfcfe74cc6927f4c087b58d0c2, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.052693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0a587-0099-4721-bbd3-e921607b6bcb admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.056426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e170f7ba3ef04dc99a28681219e19347', 'request_id': 'req-b94f5549-bdef-4083-8844-5ecd23d724ba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.065605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e170f7ba3ef04dc99a28681219e19347', 'request_id': 'req-b94f5549-bdef-4083-8844-5ecd23d724ba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.079950 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e170f7ba3ef04dc99a28681219e19347', 'request_id': 'req-b94f5549-bdef-4083-8844-5ecd23d724ba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.089172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1067/2174] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:32 2022] PUT /identity/v3/projects/2bcde2ec5e1546f9986ded050c6c1f40/users/54a030cfcfe74cc6927f4c087b58d0c2/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:33.090707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.090999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.091281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.095208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] The token cache is being invalidate because project e170f7ba3ef04dc99a28681219e19347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:33.095697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.096597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.098386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1108/2175] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:32 2022] DELETE /identity/v3/projects/e170f7ba3ef04dc99a28681219e19347 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:33.102516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.104613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:33.122196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] MFA Rules not processed for user `54a030cfcfe74cc6927f4c087b58d0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:33.123445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:33.134857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:33.247785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f5549-bdef-4083-8844-5ecd23d724ba admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.283885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1068/2176] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:33.286765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.292729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:33.374324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.377164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.377657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.378399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] PATH_INFO: `/v3/users/0a2e6ac0e3b44f928cd712897b0f2542` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.380778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2e6ac0e3b44f928cd712897b0f2542)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.382980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.478246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:33.482473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2e6ac0e3b44f928cd712897b0f2542'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.492513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226a5a-a0ec-4851-a970-ee4897c3155d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.508690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2e6ac0e3b44f928cd712897b0f2542'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.518780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.520614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2e6ac0e3b44f928cd712897b0f2542'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.521427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2e6ac0e3b44f928cd712897b0f2542'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.522430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.523970 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.524410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.534905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.539552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2e6ac0e3b44f928cd712897b0f2542'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.544444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.558951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1109/2177] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:33 2022] DELETE /identity/v3/users/0a2e6ac0e3b44f928cd712897b0f2542 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:33.642523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1069/2178] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:33 2022] POST /identity/v3/projects => generated 377 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:33.647355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.649061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:33.701834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.704019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:33.789804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39eff4-1481-4dcd-9738-01a2ed6db6ca admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.802947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.803318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060777-8280-471b-bcbe-959477975ac8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.803837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.804126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.804527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.805108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.811040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.814257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.815447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.816137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.816497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] PATH_INFO: `/v3/users/9cd3e1f4f1604e3f94a9779207a0c5ac` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.818007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd3e1f4f1604e3f94a9779207a0c5ac)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.825810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.863588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1110/2179] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:33 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:33.867233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.886240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca2039-6a62-43ae-ba9a-afc959c9ae21 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.898386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.900443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.900925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.902175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.902846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:33.903988 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.907875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.920815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd3e1f4f1604e3f94a9779207a0c5ac'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.937329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1111/2180] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:33.941978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd3e1f4f1604e3f94a9779207a0c5ac'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.943093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:33.965386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3643d1-6854-44e9-b5bb-f01fda9ff8a1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:33.972815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd3e1f4f1604e3f94a9779207a0c5ac'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.974606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd3e1f4f1604e3f94a9779207a0c5ac'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:33.977982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:33.978759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:33.979054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:33.979337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:33.981399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:33.985846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:33.998812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-ae993f72-7fca-4d56-bf6f-4e87341947ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd3e1f4f1604e3f94a9779207a0c5ac'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.009742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1070/2181] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:33 2022] DELETE /identity/v3/users/9cd3e1f4f1604e3f94a9779207a0c5ac => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:34.016384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1112/2182] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:34.016681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.016681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.016681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.023868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.034723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.040343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:34.041620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.052603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba880c0-9666-46f7-b617-1c42adfe4592 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.134363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1071/2183] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:34.135394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.136870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.142563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.143721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.144102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.144476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] PATH_INFO: `/v3/projects/f96faaba795b4f9bb34470ea6b843d05/users/74f8cc05c93f448dac995b867adaefe2/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.150795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2491bc-88ae-4b85-9b1f-b4eb6724a278 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.163903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.167743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.168032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.168313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] PATH_INFO: `/v3/projects/2a41549be6da477b88b3c2e6bd0a5fb1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.179805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a41549be6da477b88b3c2e6bd0a5fb1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.181933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.189520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96faaba795b4f9bb34470ea6b843d05, user_id=74f8cc05c93f448dac995b867adaefe2, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.195713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.222535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1113/2184] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:34 2022] PUT /identity/v3/projects/f96faaba795b4f9bb34470ea6b843d05/users/74f8cc05c93f448dac995b867adaefe2/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:34.232563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.232563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.258559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:34.266014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a41549be6da477b88b3c2e6bd0a5fb1', 'request_id': 'req-abaf4800-11bf-4db3-a524-8fa819f64ac2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.284764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a41549be6da477b88b3c2e6bd0a5fb1', 'request_id': 'req-abaf4800-11bf-4db3-a524-8fa819f64ac2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.293721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a41549be6da477b88b3c2e6bd0a5fb1', 'request_id': 'req-abaf4800-11bf-4db3-a524-8fa819f64ac2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.306749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] The token cache is being invalidate because project 2a41549be6da477b88b3c2e6bd0a5fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:34.307039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.307956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-abaf4800-11bf-4db3-a524-8fa819f64ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.309589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1072/2185] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:34 2022] DELETE /identity/v3/projects/2a41549be6da477b88b3c2e6bd0a5fb1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:34.310779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.311062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.311354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.332900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad9ef7-321e-431b-8794-c1d33eb9ae46 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.346291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] MFA Rules not processed for user `74f8cc05c93f448dac995b867adaefe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:34.348032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.387601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:34.400466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.401393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.401687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.401962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.404347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.435982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1073/2186] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:34.436982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.438290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.495771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.497264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.508130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1114/2187] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:34.508817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.510170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.522761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a5464-728e-4114-a1ca-04dcadf58b68 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.525017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271397ca-ee2e-4562-81c2-b355450e1c9b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.533111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.533282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.534125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.534235 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.534540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.534909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.535741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.543856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.545216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] PATH_INFO: `/v3/users/9dc560741a8f49a1abbd73fc48e252e8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.548580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc560741a8f49a1abbd73fc48e252e8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.550475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.551717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.616955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1115/2188] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:34 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:34.619857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.642284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc560741a8f49a1abbd73fc48e252e8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.655524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc560741a8f49a1abbd73fc48e252e8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.677743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc560741a8f49a1abbd73fc48e252e8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.679420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc560741a8f49a1abbd73fc48e252e8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.708556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc560741a8f49a1abbd73fc48e252e8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:34.733587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1074/2189] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:34 2022] DELETE /identity/v3/users/9dc560741a8f49a1abbd73fc48e252e8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:34.752536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:34.759737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ec89-70db-4698-b719-12a115f7af10 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.887755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.888970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.889357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.889729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.891340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.893584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:34.920463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1116/2190] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:34 2022] POST /identity/v3/users => generated 295 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:34.926984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:34.928526 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:34.964251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be11e54-fa89-44d9-acc5-4373d15826f7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:34.976577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:34.978339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:34.978628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:34.978908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:34.981739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:34.983426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.030265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1075/2191] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:35.034873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.047332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635938-aaac-41bf-b877-56914a6de871 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.054031 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.055923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.056356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.056818 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] PATH_INFO: `/v3/projects/88053ccd56e64c8e86fd43add03c5159/users/c76f02e259f74353aa0124806b45df89/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.091192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88053ccd56e64c8e86fd43add03c5159, user_id=c76f02e259f74353aa0124806b45df89, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.095695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.122145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1117/2192] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:35 2022] PUT /identity/v3/projects/88053ccd56e64c8e86fd43add03c5159/users/c76f02e259f74353aa0124806b45df89/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:35.126876 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.171549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ea42-12de-47bd-8cca-f752aa73bdbc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.240315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:35.261329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.263847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.301680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85805499-c719-457b-8b54-df964644945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.302607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805499-c719-457b-8b54-df964644945d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.303060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805499-c719-457b-8b54-df964644945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.303178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85805499-c719-457b-8b54-df964644945d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.303970 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85805499-c719-457b-8b54-df964644945d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.305614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85805499-c719-457b-8b54-df964644945d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.331510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1076/2193] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:35.332429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85805499-c719-457b-8b54-df964644945d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.337804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85805499-c719-457b-8b54-df964644945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.370192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85805499-c719-457b-8b54-df964644945d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.379810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.380690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.380972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.381248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] PATH_INFO: `/v3/projects/2f19819b818645719bb6effda086e5f1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.382581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f19819b818645719bb6effda086e5f1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.385202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.413160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8392b-6af7-4779-bb06-0b2a8dd97068 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.419728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.421364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.421545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.421953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] PATH_INFO: `/v3/projects/2ad441ad4d3448b78363a2d7f29f8ea3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.423436 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad441ad4d3448b78363a2d7f29f8ea3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.425383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.439971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f19819b818645719bb6effda086e5f1', 'request_id': 'req-2535550d-183c-40aa-a5ef-189c26160bb3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.448948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f19819b818645719bb6effda086e5f1', 'request_id': 'req-2535550d-183c-40aa-a5ef-189c26160bb3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.456179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f19819b818645719bb6effda086e5f1', 'request_id': 'req-2535550d-183c-40aa-a5ef-189c26160bb3'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.468699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] The token cache is being invalidate because project 2f19819b818645719bb6effda086e5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:35.469318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.470120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.472119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1077/2194] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:35 2022] DELETE /identity/v3/projects/2f19819b818645719bb6effda086e5f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:35.477277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.479389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.486999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad441ad4d3448b78363a2d7f29f8ea3', 'request_id': 'req-47e97c15-2221-4c3e-8fb6-17a44907204b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.493694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad441ad4d3448b78363a2d7f29f8ea3', 'request_id': 'req-47e97c15-2221-4c3e-8fb6-17a44907204b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.501871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad441ad4d3448b78363a2d7f29f8ea3', 'request_id': 'req-47e97c15-2221-4c3e-8fb6-17a44907204b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.510839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:35.517277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] The token cache is being invalidate because project 2ad441ad4d3448b78363a2d7f29f8ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:35.517609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.518632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47e97c15-2221-4c3e-8fb6-17a44907204b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.520692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1118/2195] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:35 2022] DELETE /identity/v3/projects/2ad441ad4d3448b78363a2d7f29f8ea3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:35.525560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.526110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.526634 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.550021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:35.551615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.553602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535550d-183c-40aa-a5ef-189c26160bb3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.623441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.624406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.624693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.624974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] PATH_INFO: `/v3/projects/88053ccd56e64c8e86fd43add03c5159/users/c76f02e259f74353aa0124806b45df89/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.627195 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88053ccd56e64c8e86fd43add03c5159, user_id=c76f02e259f74353aa0124806b45df89, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.628190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1119/2196] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:35.628938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.630123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3dfbc-6dd0-41fe-9f59-e799fa42a5d9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.630228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.636571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:35.651898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1078/2197] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:35 2022] PUT /identity/v3/projects/88053ccd56e64c8e86fd43add03c5159/users/c76f02e259f74353aa0124806b45df89/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:35.651898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52632-e283-4b1d-a2ec-fc7c9445b5df None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.651898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52632-e283-4b1d-a2ec-fc7c9445b5df None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.651898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a52632-e283-4b1d-a2ec-fc7c9445b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.659738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d16c9-bef9-4f6a-b061-abbc6f9a1b85 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.670134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-97a52632-e283-4b1d-a2ec-fc7c9445b5df None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:35.672927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-97a52632-e283-4b1d-a2ec-fc7c9445b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.730775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.732012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.732572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.732854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] PATH_INFO: `/v3/users/aad9d17c519d43f9bba4ac8c794a76e5` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.734662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad9d17c519d43f9bba4ac8c794a76e5)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.736641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:35.747330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1079/2198] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:35.748580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.748790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.749608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.782992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] MFA Rules not processed for user `c76f02e259f74353aa0124806b45df89`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:35.784295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.793764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad9d17c519d43f9bba4ac8c794a76e5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.814865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad9d17c519d43f9bba4ac8c794a76e5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.821564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad9d17c519d43f9bba4ac8c794a76e5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.822511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad9d17c519d43f9bba4ac8c794a76e5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.834783 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad9d17c519d43f9bba4ac8c794a76e5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:35.843548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1120/2199] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:35 2022] DELETE /identity/v3/users/aad9d17c519d43f9bba4ac8c794a76e5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:35.844551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.845928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.877101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:35.879515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1080/2200] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:35.892359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:35.894016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:35.965881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12984be-4aa3-4020-87ac-dcb64316445e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.973108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:35.973948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:35.975332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:35.975738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:35.976111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d0362-90d6-4f6e-a52d-d4ffc2eadcfa None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:35.976674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:35.977186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:35.979029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.019532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1121/2201] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:36.023234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.037605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefae032-3e0a-4aac-b1be-68cd78263df9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.045660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.062420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.063710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.065906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.068742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.075029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.085595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:36.117138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.117813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.118169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.118462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.120589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.131285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1122/2202] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:36.146433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.238211 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.240187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.256864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2568a4-d290-4c94-b35f-fdd045f2f5ff admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.265116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1081/2203] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:36.265427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.266580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.267072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.267490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.268490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.270817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.305754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1123/2204] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:36.307868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.325180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde95aad-b87d-40f2-9b98-6ce82963410b service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.341387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.343074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.343571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.344101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.344989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.348734 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.374385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1082/2205] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:36.375632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.404516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3cdaf-6149-4ba9-9661-3f2e208d1468 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.412507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.413343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.413841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.414215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.417427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.417427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.418917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.421837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.434696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1124/2206] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:36.448524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.449996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261dd12-d033-4fa3-a1c5-a59e98ce004f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.463938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.466164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.468382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.469871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] PATH_INFO: `/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.472333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea2e4b0b2d74d4e90a000310cb760e3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.474649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.479470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5b0d-8d6d-43f4-bd1f-cfacc5a0cba3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.495457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.498625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.499821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.500453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] PATH_INFO: `/v3/projects/c29bb29ccb8d4fac9d86a8541d1c2cc2/users/093b27ff9d6d43db8773f3fb3d95c424/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.534158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29bb29ccb8d4fac9d86a8541d1c2cc2, user_id=093b27ff9d6d43db8773f3fb3d95c424, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.538945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3dae5-6d75-4820-9ca8-00b441025bd1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.576660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1125/2207] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:36 2022] PUT /identity/v3/projects/c29bb29ccb8d4fac9d86a8541d1c2cc2/users/093b27ff9d6d43db8773f3fb3d95c424/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:36.589429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea2e4b0b2d74d4e90a000310cb760e3', 'request_id': 'req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:36.590640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.591807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.591807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.604542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea2e4b0b2d74d4e90a000310cb760e3', 'request_id': 'req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:36.618347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea2e4b0b2d74d4e90a000310cb760e3', 'request_id': 'req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:36.630255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] MFA Rules not processed for user `093b27ff9d6d43db8773f3fb3d95c424`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:36.632034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.655149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] The token cache is being invalidate because project aea2e4b0b2d74d4e90a000310cb760e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:36.655917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:36.659992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-5ded34a5-f2a1-400c-8441-0c2e9807e4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:36.662556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1083/2208] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:36 2022] DELETE /identity/v3/projects/aea2e4b0b2d74d4e90a000310cb760e3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:36.668287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac8ff-2dc6-40b1-85dc-543ee8aac243 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.668668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac8ff-2dc6-40b1-85dc-543ee8aac243 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.668976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aac8ff-2dc6-40b1-85dc-543ee8aac243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.681374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:36.705034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-82aac8ff-2dc6-40b1-85dc-543ee8aac243 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:36.706743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-82aac8ff-2dc6-40b1-85dc-543ee8aac243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.762428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1126/2209] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:36.764882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.767794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.834521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1084/2210] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:36.843122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.843636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.843923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.873783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:36.887932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:36.900415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:36.910718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d855160-be4d-41b0-abec-a478790c16c9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.915878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.916944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.917425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.918446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.919208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.921977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.928375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1085/2211] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:36.929396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.942556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10e3ad-3232-4bf5-b79e-f718418c7d13 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:36.956721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:36.957969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:36.958992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:36.959459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:36.960690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:36.962330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:36.964283 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:36.976922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1127/2212] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/projects => generated 389 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:36.978623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:36.986800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1086/2213] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:36.992191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.006968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aa9fe-6d36-49b0-9627-53e9299cc534 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.076440 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892016-ce2b-466e-b296-15e830aa85d8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.082268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.083517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.083725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.084005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.084766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.086761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.096116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.096879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.097254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.097715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.099604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.103032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.116824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1128/2214] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:37.120633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.133231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbe62a-c7e7-460f-b800-36790daa6685 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.136843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1087/2215] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:36 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:37.141033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.142264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.143967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.144491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.144969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.146479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.148680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.163424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1129/2216] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:37.166697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.180928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f00ec4-a034-4799-976b-7ac48519efb4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.243659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:37.250999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f330ac-6bd6-4619-836e-978519736cdf admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.257164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.258198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.258642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.258932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.259927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.261718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.268606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.269643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.269857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.270120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] PATH_INFO: `/v3/projects/6f23509c10a94312baf8e626817a77b9/users/4cb28333797243f89fdcf72ac8119d7a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.294969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1088/2217] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:37 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:37.295187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f23509c10a94312baf8e626817a77b9, user_id=4cb28333797243f89fdcf72ac8119d7a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.296881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.297035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.311861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20581f38-e453-4739-a4ee-913bc8239bc1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.319684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1130/2218] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:37 2022] PUT /identity/v3/projects/6f23509c10a94312baf8e626817a77b9/users/4cb28333797243f89fdcf72ac8119d7a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:37.320763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.424316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5296c4a-d7ec-45d0-b2d5-77326432252e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.433389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.434276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.434629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.434978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.435833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.438213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.462489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1131/2219] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:37.466566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.467855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.467981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.468322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.468810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.469639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.472702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.480517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137112f7-a44b-4053-9293-1c15846498a9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.480944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:37.502614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.503562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.504163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.504678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] PATH_INFO: `/v3/projects/6f23509c10a94312baf8e626817a77b9/users/4cb28333797243f89fdcf72ac8119d7a/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.504982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1089/2220] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:37.507519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f23509c10a94312baf8e626817a77b9, user_id=4cb28333797243f89fdcf72ac8119d7a, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.510444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98791b37-acc5-4912-936b-63895e13523f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.524496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.529581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1132/2221] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:37 2022] PUT /identity/v3/projects/6f23509c10a94312baf8e626817a77b9/users/4cb28333797243f89fdcf72ac8119d7a/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:37.540827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.541115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.541400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.551551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75863b17-a08b-4b3b-b03c-7f2f19e8530b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.581782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] MFA Rules not processed for user `4cb28333797243f89fdcf72ac8119d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:37.583008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:37.682909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.684327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.684801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.685251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.686448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.688292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.706223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1133/2222] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:37.706972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1090/2223] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:37.712511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.724501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:37.726309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:37.735060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefc949-507a-41c7-8a2c-b31877b04830 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.745611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.746663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.747023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.747886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] PATH_INFO: `/v3/projects/d8fc4e82ced841b2b4a16e61ca7176a2/users/b718fd45c3634febb96b44e68a60f0a0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.775985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fc4e82ced841b2b4a16e61ca7176a2, user_id=b718fd45c3634febb96b44e68a60f0a0, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:37.779734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb3b724-a737-4989-98f6-2e5fe764b9a2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:37.804072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1134/2224] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:37 2022] PUT /identity/v3/projects/d8fc4e82ced841b2b4a16e61ca7176a2/users/b718fd45c3634febb96b44e68a60f0a0/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:37.816107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.816468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.816840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:37.840702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:37.842943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f2c2-8c52-4a6a-a159-52e76f648ec2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:37.873504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] MFA Rules not processed for user `b718fd45c3634febb96b44e68a60f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:37.874811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:37.938417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:37.939605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:37.939817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:37.941323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.037838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1135/2225] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:38.043601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.082075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.083969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.089446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:38.097081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1091/2226] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:38.171743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba20e8-53fd-447b-aef2-864826b6e0a8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.173854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.176981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.177687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.177978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.178258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.179124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.181226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.194344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2cc58-3d22-46ae-9a32-07d5b1f9a379 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.198900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.199695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.200067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.200381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.202957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.219555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1136/2227] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:38 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:38.222774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.278352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.279757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.289764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1092/2228] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:38.290558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.301481 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e39a7-6521-4aad-b6f5-5f220f96e9ef service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.305586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4cf9-c8f3-4469-9202-81b693e9a17a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.306511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.307479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.307750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.308023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] PATH_INFO: `/v3/users/093b27ff9d6d43db8773f3fb3d95c424` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.309217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=093b27ff9d6d43db8773f3fb3d95c424)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.311729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.312311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.313023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.313320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.314511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.315221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.317248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.346655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1137/2229] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:38 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:38.351220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.362764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824173c0-4f11-4164-ba41-7404eb923505 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.371518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.373103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.373103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.373757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.373949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093b27ff9d6d43db8773f3fb3d95c424'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:38.374889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.377299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.381603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093b27ff9d6d43db8773f3fb3d95c424'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:38.385072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:38.397468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1138/2230] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:38.398439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.404021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093b27ff9d6d43db8773f3fb3d95c424'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:38.404904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093b27ff9d6d43db8773f3fb3d95c424'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:38.409243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216c1de-90a8-40ea-8c9f-74cbd542a866 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.414719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.415844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.416234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.416626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] PATH_INFO: `/v3/projects/c79481f5871c4574b9e0e05cac0384ff/users/b53291ac8f4e4b688e2740cf06c61691/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.416977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-da49d87d-8e04-4b6d-9699-051b2c8a3dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093b27ff9d6d43db8773f3fb3d95c424'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:38.430514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1093/2231] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:38 2022] DELETE /identity/v3/users/093b27ff9d6d43db8773f3fb3d95c424 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:38.431786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.432071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.432349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.434811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79481f5871c4574b9e0e05cac0384ff, user_id=b53291ac8f4e4b688e2740cf06c61691, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.438332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.453725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:38.454932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.456303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1139/2232] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:38 2022] PUT /identity/v3/projects/c79481f5871c4574b9e0e05cac0384ff/users/b53291ac8f4e4b688e2740cf06c61691/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:38.460246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.462994 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.540288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cb274-a536-498d-a10d-39810b941153 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.541690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1094/2233] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:38.548856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.549537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.549824 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.550334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.550828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.551301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.552512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.552892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.564617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1140/2234] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:38.568771 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.569560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:38.591566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d8c6-fc3d-43c8-9923-c7e6d58d9156 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.601425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.602335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.602643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.602892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] PATH_INFO: `/v3/projects/c79481f5871c4574b9e0e05cac0384ff/users/b53291ac8f4e4b688e2740cf06c61691/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.605553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79481f5871c4574b9e0e05cac0384ff, user_id=b53291ac8f4e4b688e2740cf06c61691, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.609632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67705c7-6d56-401f-ba16-c4ff4e9ff0a8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.621717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1141/2235] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:38 2022] PUT /identity/v3/projects/c79481f5871c4574b9e0e05cac0384ff/users/b53291ac8f4e4b688e2740cf06c61691/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:38.625034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb053-888d-447b-9218-9fa1611d3efc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.631949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.632240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.632523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.668116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] MFA Rules not processed for user `b53291ac8f4e4b688e2740cf06c61691`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:38.669838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.716105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.717430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.717693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.718030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.765111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1142/2236] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:38.766243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:38.768448 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:38.818980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.820927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.840485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1095/2237] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:38.840705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:38.864473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596324b-2606-466a-bd2e-a3d8ca5d7d8d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:38.870273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:38.870942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:38.871227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:38.871533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:38.887379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:38.887379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:38.897148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1143/2238] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:39.230183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:39.243189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf1ad-5b99-40a9-ad59-2350c497e1c6 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:39.261631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:39.263213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:39.264613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:39.265482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:39.266679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:39.267117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:39.269174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:39.290146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1577d-250a-4881-8e81-5b269f063dd3 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:39.298616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:39.299550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:39.299884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:39.300167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] PATH_INFO: `/v3/projects/c29bb29ccb8d4fac9d86a8541d1c2cc2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:39.301860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29bb29ccb8d4fac9d86a8541d1c2cc2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:39.309373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:39.409296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:39.410121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29bb29ccb8d4fac9d86a8541d1c2cc2', 'request_id': 'req-970d4b00-09aa-46c0-8130-9beb47ecfe38'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.411436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:39.417835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29bb29ccb8d4fac9d86a8541d1c2cc2', 'request_id': 'req-970d4b00-09aa-46c0-8130-9beb47ecfe38'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.426285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1096/2239] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:39.443878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29bb29ccb8d4fac9d86a8541d1c2cc2', 'request_id': 'req-970d4b00-09aa-46c0-8130-9beb47ecfe38'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.460268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] The token cache is being invalidate because project c29bb29ccb8d4fac9d86a8541d1c2cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:39.460557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.461215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.462775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1144/2240] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:39 2022] DELETE /identity/v3/projects/c29bb29ccb8d4fac9d86a8541d1c2cc2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:39.467333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:39.480047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d40dc9-7dc3-4b5d-8ef8-6f0de523b186 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:39.493361 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:39.554807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:39.555709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:39.555992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:39.556267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] PATH_INFO: `/v3/users/4cb28333797243f89fdcf72ac8119d7a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:39.557487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb28333797243f89fdcf72ac8119d7a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:39.559444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:39.613406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb28333797243f89fdcf72ac8119d7a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.620474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb28333797243f89fdcf72ac8119d7a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.635508 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb28333797243f89fdcf72ac8119d7a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.636178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb28333797243f89fdcf72ac8119d7a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.644144 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb28333797243f89fdcf72ac8119d7a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.650442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1097/2241] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:39 2022] DELETE /identity/v3/users/4cb28333797243f89fdcf72ac8119d7a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:39.809499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:39.811734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:39.826228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d4b00-09aa-46c0-8130-9beb47ecfe38 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:39.907119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:39.908107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:39.908428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:39.908672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] PATH_INFO: `/v3/users/b718fd45c3634febb96b44e68a60f0a0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:39.910213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b718fd45c3634febb96b44e68a60f0a0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:39.912622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:39.970405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b718fd45c3634febb96b44e68a60f0a0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:39.973763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:39.976329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:39.995287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e527-66ee-40b1-9983-c301dac325b1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.008753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b718fd45c3634febb96b44e68a60f0a0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.019413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:40.032363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.033283 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.033532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.033846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] PATH_INFO: `/v3/projects/6f23509c10a94312baf8e626817a77b9` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.035170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f23509c10a94312baf8e626817a77b9)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.038400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.038742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b718fd45c3634febb96b44e68a60f0a0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.039653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b718fd45c3634febb96b44e68a60f0a0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.050708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-814ddec4-1107-4aba-a79c-68d1a3412b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b718fd45c3634febb96b44e68a60f0a0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.062465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1145/2242] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:39 2022] DELETE /identity/v3/users/b718fd45c3634febb96b44e68a60f0a0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:40.064560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.064814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.065092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.085115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:40.086320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.114822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f23509c10a94312baf8e626817a77b9', 'request_id': 'req-4139d371-a8e3-49e3-bd68-9201e9bff213'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.122339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f23509c10a94312baf8e626817a77b9', 'request_id': 'req-4139d371-a8e3-49e3-bd68-9201e9bff213'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.129127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f23509c10a94312baf8e626817a77b9', 'request_id': 'req-4139d371-a8e3-49e3-bd68-9201e9bff213'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.141423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] The token cache is being invalidate because project 6f23509c10a94312baf8e626817a77b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:40.141975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.142735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4139d371-a8e3-49e3-bd68-9201e9bff213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.144439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1098/2243] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:39 2022] DELETE /identity/v3/projects/6f23509c10a94312baf8e626817a77b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:40.149587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffaa08-04c2-4800-9558-9b18f23269f4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.149878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffaa08-04c2-4800-9558-9b18f23269f4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.150155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffaa08-04c2-4800-9558-9b18f23269f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.153755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1146/2244] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:40.165421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.166851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.170260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f3ffaa08-04c2-4800-9558-9b18f23269f4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:40.171548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3ffaa08-04c2-4800-9558-9b18f23269f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.180685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:40.234611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bb5ba-0d0c-4c86-9862-d0d432d22c8f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.238451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1099/2245] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:40.245894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.246189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.246469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.266408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:40.267671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.275749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1100/2246] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:40.280428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.288019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.288706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.288992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.289267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb5f4a-2861-4f05-89c7-99bc2cb2eecb None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.289373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.293920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.295218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.295554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.295800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.296518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:40.296821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.298513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.299415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.301192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.310469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1147/2247] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:40.311622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1101/2248] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:40.316679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.326843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6eb0-6c13-4381-83cd-d012c24e6dc8 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.331728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.332487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.332772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.333047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.333896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.336315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.364134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1148/2249] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:40.368363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.379550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0069-25af-477c-aeee-8494573f6154 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.470328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.471062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.471390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.471813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.472533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.474690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.499816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1102/2250] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:40.504120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.520521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907dd6d-2ac7-4fb5-a509-1279f30faf0f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.527952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.529560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.529955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.530441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.532276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.535165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.552265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1149/2251] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:40.556841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.571987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00845a-0ac9-44b5-a61b-1ba39c599573 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.580388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.581512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.582069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.582711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.583692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.585617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8d643-2c9f-4c91-a42b-ce3899245bf9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.599408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1103/2252] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:40.604295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.620422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7f5a-6bc4-473d-99b0-3b3e86ff20b4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.631965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.631965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.631965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.631965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] PATH_INFO: `/v3/projects/50eb3b184571440eb48794f309970753/users/7ccb7d663f974f1f8259c6275c89e65c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.647865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:40.651466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=50eb3b184571440eb48794f309970753, user_id=7ccb7d663f974f1f8259c6275c89e65c, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.654984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.672512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1150/2253] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:40 2022] PUT /identity/v3/projects/50eb3b184571440eb48794f309970753/users/7ccb7d663f974f1f8259c6275c89e65c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:40.683771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.684117 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.684397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.719762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.721596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.726041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] MFA Rules not processed for user `7ccb7d663f974f1f8259c6275c89e65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:40.727552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.805331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c231a64-259b-45e6-89fd-6d36dc6a41cd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:40.817302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:40.818083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1104/2254] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:40.818288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:40.818526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:40.818907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] PATH_INFO: `/v3/projects/d8fc4e82ced841b2b4a16e61ca7176a2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:40.824469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fc4e82ced841b2b4a16e61ca7176a2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:40.827744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:40.834685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.836318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.843516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:40.898551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fc4e82ced841b2b4a16e61ca7176a2', 'request_id': 'req-bf92c0fe-7b51-4387-b875-51af97534694'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.905861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fc4e82ced841b2b4a16e61ca7176a2', 'request_id': 'req-bf92c0fe-7b51-4387-b875-51af97534694'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.914797 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fc4e82ced841b2b4a16e61ca7176a2', 'request_id': 'req-bf92c0fe-7b51-4387-b875-51af97534694'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.929330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] The token cache is being invalidate because project d8fc4e82ced841b2b4a16e61ca7176a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:40.929696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.930976 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:40.941006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1151/2255] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:40 2022] DELETE /identity/v3/projects/d8fc4e82ced841b2b4a16e61ca7176a2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:40.945191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:40.947662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:40.949485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd9499-7682-4540-86be-5c5e850ae715 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.018501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.019254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.019570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.019862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.021655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.025898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c0fe-7b51-4387-b875-51af97534694 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.031521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.032277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.032552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.032832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] PATH_INFO: `/v3/users/b53291ac8f4e4b688e2740cf06c61691` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.034070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53291ac8f4e4b688e2740cf06c61691)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.036074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.065789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:41.089915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.092214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.104334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1105/2256] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:41.107723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53291ac8f4e4b688e2740cf06c61691'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.125387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53291ac8f4e4b688e2740cf06c61691'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.125655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.128135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.133084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53291ac8f4e4b688e2740cf06c61691'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.133714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53291ac8f4e4b688e2740cf06c61691'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.142826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-380b3426-4fd6-418f-bb3d-79cf2579bb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53291ac8f4e4b688e2740cf06c61691'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.145127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2a61-7084-457b-b4f2-e6dfd2c5aab3 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.149692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1152/2257] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:40 2022] DELETE /identity/v3/users/b53291ac8f4e4b688e2740cf06c61691 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:41.150705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.151654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.152189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.152474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] PATH_INFO: `/v3/users/7ccb7d663f974f1f8259c6275c89e65c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.155921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccb7d663f974f1f8259c6275c89e65c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.158192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.209279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccb7d663f974f1f8259c6275c89e65c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.219535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccb7d663f974f1f8259c6275c89e65c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.229778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:41.236622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccb7d663f974f1f8259c6275c89e65c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.237499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccb7d663f974f1f8259c6275c89e65c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.246054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccb7d663f974f1f8259c6275c89e65c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.255463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1106/2258] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:41 2022] DELETE /identity/v3/users/7ccb7d663f974f1f8259c6275c89e65c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:41.258848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.259314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.259728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.281492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:41.282865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.345592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1153/2259] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:41.355600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.357946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.423436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f134d-bd03-4583-a0e8-2a7250619457 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.427909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.428622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.429007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.429315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.441159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.442471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.446122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.447585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d9d2-9899-490a-8e3f-04f94ccedad3 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.456201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d199e-7c1e-4839-b599-ebd1d21bfc96 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.472671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1107/2260] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:41.475972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.480165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.481084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.481499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] PATH_INFO: `/v3/projects/c79481f5871c4574b9e0e05cac0384ff` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.484048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79481f5871c4574b9e0e05cac0384ff)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.486132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.549948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79481f5871c4574b9e0e05cac0384ff', 'request_id': 'req-25cdba62-4620-47e1-b488-d89c05a006ca'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.558062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79481f5871c4574b9e0e05cac0384ff', 'request_id': 'req-25cdba62-4620-47e1-b488-d89c05a006ca'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.566339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79481f5871c4574b9e0e05cac0384ff', 'request_id': 'req-25cdba62-4620-47e1-b488-d89c05a006ca'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.581582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] The token cache is being invalidate because project c79481f5871c4574b9e0e05cac0384ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:41.581876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.582573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-25cdba62-4620-47e1-b488-d89c05a006ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:41.584315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1154/2261] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:41 2022] DELETE /identity/v3/projects/c79481f5871c4574b9e0e05cac0384ff => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:41.590318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.590721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.590913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.611025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:41.612409 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.698713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1108/2262] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:41.706916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.707250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.707706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.732979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:41.734286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.749107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1155/2263] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:41.750688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.763414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c048-c3d5-48fa-a7ae-575d4a613787 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.769289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.770050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.770413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.770770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.772721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:41.772721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.774243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.792072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1109/2264] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:41.796982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.809445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7ef67-0741-47b8-9bec-123856e4f4e8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.815864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.826206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.826206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.826206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.826206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.826206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.830254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.832130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:41.846728 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:41.864807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229308c-1640-43db-ae5f-c3adfa6d8cfe admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.865667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1156/2265] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:41 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:41.869803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:41.944770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.944997 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb7df3-3272-4f6f-8eee-c00da66072f6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:41.945890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.946337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.946766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] PATH_INFO: `/v3/projects/50eb3b184571440eb48794f309970753` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.948146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50eb3b184571440eb48794f309970753)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.950961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:41.951291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.951828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:41.952315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:41.952674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:41.953485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:41.956056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:41.975854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:41.979229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1157/2266] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:41 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:41.984103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.000433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d708-ec1f-4e6f-9d61-a307a2473ffb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.015293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50eb3b184571440eb48794f309970753', 'request_id': 'req-4bb9d036-7f88-444e-9122-3dfeca5117c9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.022910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50eb3b184571440eb48794f309970753', 'request_id': 'req-4bb9d036-7f88-444e-9122-3dfeca5117c9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.029213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50eb3b184571440eb48794f309970753', 'request_id': 'req-4bb9d036-7f88-444e-9122-3dfeca5117c9'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.044771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] The token cache is being invalidate because project 50eb3b184571440eb48794f309970753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:42.045282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.046349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4bb9d036-7f88-444e-9122-3dfeca5117c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.048881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1110/2267] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:41 2022] DELETE /identity/v3/projects/50eb3b184571440eb48794f309970753 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:42.053852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cbe3-899e-4acc-bef9-c686fe054851 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.054139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cbe3-899e-4acc-bef9-c686fe054851 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.054415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cbe3-899e-4acc-bef9-c686fe054851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.065736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.066411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.066699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.066974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.067748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.069346 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.072807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-e6e5cbe3-899e-4acc-bef9-c686fe054851 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:42.074024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e6e5cbe3-899e-4acc-bef9-c686fe054851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.079894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1158/2268] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:42.084199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.085988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1111/2269] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:42.086248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.094216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7775-0702-40da-a4e1-794481784b6b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.094512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7775-0702-40da-a4e1-794481784b6b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.094795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c7775-0702-40da-a4e1-794481784b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.101285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f372b5-fa47-4c39-b4b8-dbae3b58847a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.107829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.108587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.108983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.109295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.110161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.112219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.116813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-156c7775-0702-40da-a4e1-794481784b6b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:42.118084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-156c7775-0702-40da-a4e1-794481784b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.127414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1159/2270] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:42.131201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.131786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1112/2271] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:42.135670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c7775-0702-40da-a4e1-794481784b6b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.145005 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2402-55ce-4b33-ac36-4004cdf14466 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.145901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c7775-0702-40da-a4e1-794481784b6b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.149858 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.150678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.150815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.150967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.151234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] PATH_INFO: `/v3/projects/2322168a437449a0b10396724b5a3d0b/users/d33828e71df04f92a89030bcb9b2ceb9/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.151400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.151681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.151958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.152680 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:42.152987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.155382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.170470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2322168a437449a0b10396724b5a3d0b, user_id=d33828e71df04f92a89030bcb9b2ceb9, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.170665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1113/2272] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:42.170764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ccc3e-c6d5-41f7-aa63-b2819807fdac admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.171644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.183514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7a31-3ce7-45af-824a-58fc8132bb2e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.184424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1160/2273] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:42 2022] PUT /identity/v3/projects/2322168a437449a0b10396724b5a3d0b/users/d33828e71df04f92a89030bcb9b2ceb9/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:42.195672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.195992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.196278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.223966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] MFA Rules not processed for user `d33828e71df04f92a89030bcb9b2ceb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:42.225171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.246315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.246997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.247915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.248202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.248887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.250816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.259920 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:42.281610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1114/2274] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:42.283080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.296727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1161/2275] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:42.308642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.310464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.362791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7429d-fcf5-4814-99ae-ea6437fff903 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.367345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.368046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.368331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.368610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.369310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.371823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.379130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549479b-6182-4fe3-bff6-05f9a6523d43 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.383764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:42.411873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1115/2276] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:42.415210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.427019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70888ec7-196e-4adc-9a3f-daf50ca6a5a2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.434837 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.435795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.435933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.436094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.436925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.438836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.438963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.439703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.440056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.440361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.453116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1116/2277] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:42.454164 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.465623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c100672-142e-408b-880a-522aaa028437 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.471742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.472502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.472790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.473065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.473849 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.475580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.486978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1117/2278] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:42.491172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.501586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164ab0-55ed-4df5-a208-dd7a5471cf3e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.506315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.507173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.507478 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.507757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] PATH_INFO: `/v3/projects/4d68a840bcd747c18764d639bf493acb/users/781a40ea1f8d4caab154d0158c70f8f1/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.514571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.516045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293c4b2-bac9-49ac-826f-bd7d66997ad9 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.523982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d68a840bcd747c18764d639bf493acb, user_id=781a40ea1f8d4caab154d0158c70f8f1, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.525475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1162/2279] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:42.526640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.540611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1118/2280] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:42 2022] PUT /identity/v3/projects/4d68a840bcd747c18764d639bf493acb/users/781a40ea1f8d4caab154d0158c70f8f1/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:42.551032 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.551352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.551663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.583390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] MFA Rules not processed for user `781a40ea1f8d4caab154d0158c70f8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:42.584626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.618910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:42.659248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1163/2281] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:42.671548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.673253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:42.740486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70466c0b-13fc-4505-b761-f927cfd4560d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.744340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.744992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.745276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.745549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.754915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.756475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1796adc-e2d4-4f0b-96a6-6c26907b73c4 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.766547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1119/2282] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:42.786622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:42.869052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0562-c7cf-405a-9dc4-b1b642c73c35 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:42.874846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:42.875778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:42.876061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:42.876363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] PATH_INFO: `/v3/users/781a40ea1f8d4caab154d0158c70f8f1` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:42.877577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=781a40ea1f8d4caab154d0158c70f8f1)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:42.879867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:42.944405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781a40ea1f8d4caab154d0158c70f8f1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.967784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781a40ea1f8d4caab154d0158c70f8f1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.976630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781a40ea1f8d4caab154d0158c70f8f1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.976630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781a40ea1f8d4caab154d0158c70f8f1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:42.994183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781a40ea1f8d4caab154d0158c70f8f1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.004892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1164/2283] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:42 2022] DELETE /identity/v3/users/781a40ea1f8d4caab154d0158c70f8f1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:43.011595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:43.012260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:43.013473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:43.034914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:43.036586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:43.170125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1120/2284] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:43.182682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:43.184981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:43.321305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402eb34-6875-470e-b8be-08080c6825bd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:43.326099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:43.326808 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:43.327097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:43.327402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:43.338508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:43.339978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba334d-c912-4db3-8503-adcbcde4eff0 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:43.345658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:43.355444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1165/2285] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:43.795587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:43.797375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:43.832732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c1a5-de12-48d8-bd83-84488becac9d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:43.838771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:43.839787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:43.840083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:43.840493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] PATH_INFO: `/v3/projects/4d68a840bcd747c18764d639bf493acb` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:43.841805 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d68a840bcd747c18764d639bf493acb)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:43.844136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:43.904751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d68a840bcd747c18764d639bf493acb', 'request_id': 'req-4aca2480-03a0-4eec-8142-4f6bea25a30c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.904751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:43.920394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d68a840bcd747c18764d639bf493acb', 'request_id': 'req-4aca2480-03a0-4eec-8142-4f6bea25a30c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.934778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d68a840bcd747c18764d639bf493acb', 'request_id': 'req-4aca2480-03a0-4eec-8142-4f6bea25a30c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.950747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] The token cache is being invalidate because project 4d68a840bcd747c18764d639bf493acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:43.951531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.952423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4aca2480-03a0-4eec-8142-4f6bea25a30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:43.954654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1121/2286] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:43 2022] DELETE /identity/v3/projects/4d68a840bcd747c18764d639bf493acb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:43.959275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:43.959815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:43.959945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:43.981655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:43.983053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.052876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1166/2287] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:44.066300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.066826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.067000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.088210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:44.089454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.098258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1122/2288] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:44.102402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.112338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0a955-febb-4868-ab7a-90355c81e80f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.116945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.117593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.117874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.118148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.118886 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:44.119192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.121099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.133201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1167/2289] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:29:44.138387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.148048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b679758-c9fa-4948-8e70-15b05c4d8b33 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.152918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.153677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.153990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.154354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.155166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.157328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.182084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1123/2290] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:44 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:44.186525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.196799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b622c8-f81d-4fd8-892f-d8d586db99b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.255566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.256252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.256542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.256815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.257533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.259498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.292837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1168/2291] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:44 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:44.293996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.305206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934490af-4f89-4556-9b08-e61675b2d771 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.311149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.311948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.312307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.312933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.313774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.315532 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.330515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1124/2292] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:44.334900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.349989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44068b-4607-4f1c-aa85-7df43e31632b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.355975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.356659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.356949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.357230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.357996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.359619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe2ec9-f255-456a-8e4d-250f5ea76041 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.374231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1169/2293] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:44.375496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.388560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09bb2b-4e2d-4a28-af84-266fa5c3474e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.394512 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.396057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.396057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.396258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] PATH_INFO: `/v3/projects/1f4c34e9edec430eb37d05598bcdbc09/users/ebadff03d4684c3f8fd95001ee1b7ffc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.415075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4c34e9edec430eb37d05598bcdbc09, user_id=ebadff03d4684c3f8fd95001ee1b7ffc, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.417788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.436151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1125/2294] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:44 2022] PUT /identity/v3/projects/1f4c34e9edec430eb37d05598bcdbc09/users/ebadff03d4684c3f8fd95001ee1b7ffc/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:44.446602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.446896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.447190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.475645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] MFA Rules not processed for user `ebadff03d4684c3f8fd95001ee1b7ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:44.476887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.531279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:44.542330 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1170/2295] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:44.553796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.555531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.615708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdfd49-49d8-4b0d-91c6-3c353cadb036 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.619407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.620057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.620338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.620610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.629735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.630764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.631029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.632290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9077ae5-3626-447c-b7aa-843c0f220fb8 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.642550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1126/2296] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:44.703203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e1412-09aa-4bee-8045-01c336727574 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:44.708163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:44.708873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.709162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.709443 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] PATH_INFO: `/v3/users/54a030cfcfe74cc6927f4c087b58d0c2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.710658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a030cfcfe74cc6927f4c087b58d0c2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:44.712621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:44.770706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a030cfcfe74cc6927f4c087b58d0c2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:44.792114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a030cfcfe74cc6927f4c087b58d0c2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:44.811508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a030cfcfe74cc6927f4c087b58d0c2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:44.815992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a030cfcfe74cc6927f4c087b58d0c2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:44.854901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a030cfcfe74cc6927f4c087b58d0c2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:44.862979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1171/2297] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:44 2022] DELETE /identity/v3/users/54a030cfcfe74cc6927f4c087b58d0c2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:29:44.867604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:44.867902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:44.868185 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:44.887415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:44.888759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:44.964864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1127/2298] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:44.976591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:44.979148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:45.044637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641c77e-ccf5-4b9f-bfdf-5b51e28f6724 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:45.048769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:45.049429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:45.049734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:45.050015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:45.060678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:45.062102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:45.071754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1172/2299] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:45.369446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:45.371004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:45.389519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05bfcc-43e2-4889-b654-b7ab1f6e7673 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:45.398207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:45.399247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:45.399576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:45.399857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] PATH_INFO: `/v3/projects/2bcde2ec5e1546f9986ded050c6c1f40` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:45.401529 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bcde2ec5e1546f9986ded050c6c1f40)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:45.403591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:45.432733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.518476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcde2ec5e1546f9986ded050c6c1f40', 'request_id': 'req-74f218a9-5836-43e6-9f70-75e177c0c5ee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.529091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcde2ec5e1546f9986ded050c6c1f40', 'request_id': 'req-74f218a9-5836-43e6-9f70-75e177c0c5ee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.536205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcde2ec5e1546f9986ded050c6c1f40', 'request_id': 'req-74f218a9-5836-43e6-9f70-75e177c0c5ee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.560163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] The token cache is being invalidate because project 2bcde2ec5e1546f9986ded050c6c1f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:45.560460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.561130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.566853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:45.567410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1128/2300] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:45 2022] DELETE /identity/v3/projects/2bcde2ec5e1546f9986ded050c6c1f40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:45.579630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e646611-0e30-46e4-a08d-96cb68cb7058 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:45.594000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:45.664697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:45.665670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:45.666014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:45.666359 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] PATH_INFO: `/v3/users/74f8cc05c93f448dac995b867adaefe2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:45.667683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f8cc05c93f448dac995b867adaefe2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:45.670421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:45.726471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f8cc05c93f448dac995b867adaefe2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.742546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f8cc05c93f448dac995b867adaefe2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.751001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f8cc05c93f448dac995b867adaefe2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.752286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f8cc05c93f448dac995b867adaefe2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.762506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f8cc05c93f448dac995b867adaefe2'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:45.770104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1173/2301] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:45 2022] DELETE /identity/v3/users/74f8cc05c93f448dac995b867adaefe2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:46.077917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:46.080174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:46.096990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f218a9-5836-43e6-9f70-75e177c0c5ee admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:46.157479 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:46.158365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:46.158659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:46.158937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] PATH_INFO: `/v3/projects/f96faaba795b4f9bb34470ea6b843d05` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:46.160183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96faaba795b4f9bb34470ea6b843d05)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:46.162800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:46.211007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96faaba795b4f9bb34470ea6b843d05', 'request_id': 'req-32d86360-c97a-4dea-a3d3-79f6680f1a16'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.219011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96faaba795b4f9bb34470ea6b843d05', 'request_id': 'req-32d86360-c97a-4dea-a3d3-79f6680f1a16'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.224733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96faaba795b4f9bb34470ea6b843d05', 'request_id': 'req-32d86360-c97a-4dea-a3d3-79f6680f1a16'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.238595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] The token cache is being invalidate because project f96faaba795b4f9bb34470ea6b843d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:46.238889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.239581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.241237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1129/2302] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:46 2022] DELETE /identity/v3/projects/f96faaba795b4f9bb34470ea6b843d05 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:46.245049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:46.246716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:46.260729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48489ffd-00ff-4eef-9e1b-b09b129de07c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:46.320622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:46.321620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:46.321947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:46.322271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] PATH_INFO: `/v3/users/c76f02e259f74353aa0124806b45df89` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:46.323564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76f02e259f74353aa0124806b45df89)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:46.325829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:46.370712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.380284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76f02e259f74353aa0124806b45df89'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.394027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76f02e259f74353aa0124806b45df89'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.401598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76f02e259f74353aa0124806b45df89'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.403442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76f02e259f74353aa0124806b45df89'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.414235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8a2beac3-4113-43ec-ac6a-7c058fb1e2d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76f02e259f74353aa0124806b45df89'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.422582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1174/2303] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:46 2022] DELETE /identity/v3/users/c76f02e259f74353aa0124806b45df89 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:46.724954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:46.727071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:46.746911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86360-c97a-4dea-a3d3-79f6680f1a16 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:46.775192 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:46.827473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:46.828860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:46.829304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:46.829693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] PATH_INFO: `/v3/projects/88053ccd56e64c8e86fd43add03c5159` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:46.830855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88053ccd56e64c8e86fd43add03c5159)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:46.832871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:46.884693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88053ccd56e64c8e86fd43add03c5159', 'request_id': 'req-8697c584-c4bd-4789-b518-a82b86f047b2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.893482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88053ccd56e64c8e86fd43add03c5159', 'request_id': 'req-8697c584-c4bd-4789-b518-a82b86f047b2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.901482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88053ccd56e64c8e86fd43add03c5159', 'request_id': 'req-8697c584-c4bd-4789-b518-a82b86f047b2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.913963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] The token cache is being invalidate because project 88053ccd56e64c8e86fd43add03c5159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:46.914252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.915427 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8697c584-c4bd-4789-b518-a82b86f047b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:46.916998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1130/2304] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:46 2022] DELETE /identity/v3/projects/88053ccd56e64c8e86fd43add03c5159 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:46.923572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:46.923875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:46.924159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:46.944119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:46.945500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:47.013058 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1175/2305] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:47.020844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.021139 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.021423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.048368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:47.049589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:47.059946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1131/2306] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:47.064813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.081475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b1a21-b6dc-4ce7-8614-1e43b6bdc6b2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.099303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.100183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.100447 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.100753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.101561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:47.101877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.103534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.122056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1176/2307] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:47.123178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.143150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43dfde-8abe-429b-bd94-47fad39031a0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.148625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.149418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.150056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.150413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.151199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.154084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.190716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1132/2308] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:47 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:47.191850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.202172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b128c-ad67-45e8-a278-e618dff8b9cf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.277484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.278438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.278561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.278741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.279467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.281594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.303111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1177/2309] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:47 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:29:47.307480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.319744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecb9e4-53c5-4295-9431-9e46fd532ed8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.325426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.326133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.326375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.326649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.327704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.329315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.341554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1133/2310] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:47.345714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.356450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3414-da45-4df1-9839-b5370fa561cf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.361298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.362002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.362318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.362627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.363405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.365070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b85e9-a888-42b6-bce9-9e308ae4a436 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.379164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1178/2311] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:29:47.380474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.392431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60d0c4-73ef-41a5-ad86-1dda3a1d2409 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.397461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.398383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.399036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.399324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] PATH_INFO: `/v3/projects/0fc9efb0d4ac4ac18b16e6287a636c72/users/4e01c2b4c0b54ac4b199e224d6d8fe8b/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.415265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc9efb0d4ac4ac18b16e6287a636c72, user_id=4e01c2b4c0b54ac4b199e224d6d8fe8b, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.418067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.431853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1134/2312] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:47 2022] PUT /identity/v3/projects/0fc9efb0d4ac4ac18b16e6287a636c72/users/4e01c2b4c0b54ac4b199e224d6d8fe8b/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:47.444172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36c06-7813-4724-aa0a-90712cee6686 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.444483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36c06-7813-4724-aa0a-90712cee6686 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.444834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b36c06-7813-4724-aa0a-90712cee6686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.473398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-56b36c06-7813-4724-aa0a-90712cee6686 None None] MFA Rules not processed for user `4e01c2b4c0b54ac4b199e224d6d8fe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:47.474840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-56b36c06-7813-4724-aa0a-90712cee6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:47.484906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:47.550305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1179/2313] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:47.561588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:47.563586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:47.623591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7ea6f-fa1f-4774-8cb8-f9b215d2c90c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:47.627165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:47.627907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:47.628268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:47.628549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:47.634816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:47.638169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:47.639857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e490e-7c11-4ce5-ad71-bd709908e824 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:47.650250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1135/2314] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:53.432524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:53.434130 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:53.434631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:53.437923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1180/2315] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:29:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:29:53.448906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:53.450999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:53.452820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:53.498335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] MFA Rules not processed for user `5dc27c2736384fdd91fad3d94422807b`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:53.499998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:53.573137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:53.575263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:53.706977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1136/2316] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:29:53.728163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:53.729644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:53.738942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808347-3ce8-4565-a2ee-7b36cddea43a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:53.748205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:53.749134 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:53.749416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:53.749699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] PATH_INFO: `/v3/users/cc97a6a0bcb84e4fb5513d5891d805b5` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:53.750991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc97a6a0bcb84e4fb5513d5891d805b5)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:53.751868 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1696-cfa3-436b-923b-acd4eea53710 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:53.753049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:53.759356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:53.760662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:53.760662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:53.760865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:53.771311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:53.772999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:53.785596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1137/2317] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:29:53.830779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc97a6a0bcb84e4fb5513d5891d805b5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:53.844874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc97a6a0bcb84e4fb5513d5891d805b5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:53.855195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc97a6a0bcb84e4fb5513d5891d805b5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:53.856014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc97a6a0bcb84e4fb5513d5891d805b5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:53.864910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc97a6a0bcb84e4fb5513d5891d805b5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:53.869652 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:53.877135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1181/2318] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:53 2022] DELETE /identity/v3/users/cc97a6a0bcb84e4fb5513d5891d805b5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:54.088395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:54.106705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a12bc2-689a-408c-a4f6-58d48421d2ca service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:54.175912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:54.176892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:54.177239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:54.177583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] PATH_INFO: `/v3/projects/960812e1828d4a9cb91585ea8f6802a1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:54.178871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960812e1828d4a9cb91585ea8f6802a1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:54.180896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:54.220372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:54.236060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960812e1828d4a9cb91585ea8f6802a1', 'request_id': 'req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.245104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960812e1828d4a9cb91585ea8f6802a1', 'request_id': 'req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.250933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960812e1828d4a9cb91585ea8f6802a1', 'request_id': 'req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.262975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] The token cache is being invalidate because project 960812e1828d4a9cb91585ea8f6802a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:54.263275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.263957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.265558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1138/2319] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:54 2022] DELETE /identity/v3/projects/960812e1828d4a9cb91585ea8f6802a1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:54.269631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:54.277564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:54.295227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe321f0-ccd0-4c08-8139-5307f9cc2258 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:54.362107 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:54.362996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:54.363276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:54.363587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] PATH_INFO: `/v3/users/4dac0d870a334acabaea8c856e689318` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:54.365433 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dac0d870a334acabaea8c856e689318)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:54.367402 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:54.424580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dac0d870a334acabaea8c856e689318'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.438960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dac0d870a334acabaea8c856e689318'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.448683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dac0d870a334acabaea8c856e689318'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.449430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dac0d870a334acabaea8c856e689318'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.461674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a6b3d6f2-26cf-44bb-a6af-bfabc16c5891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dac0d870a334acabaea8c856e689318'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.468019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1182/2320] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:54 2022] DELETE /identity/v3/users/4dac0d870a334acabaea8c856e689318 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:54.699177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:54.701161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:54.716476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3c67a-1a2e-4fcd-aa79-72cd5d728e05 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:54.814450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:54.815325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:54.815633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:54.815901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] PATH_INFO: `/v3/projects/b1aca89227a643c2aba4f4b09c41bef7` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:54.817105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aca89227a643c2aba4f4b09c41bef7)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:54.819056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:54.879650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aca89227a643c2aba4f4b09c41bef7', 'request_id': 'req-c588d768-74c3-4242-8333-e01b66a3443e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.888196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aca89227a643c2aba4f4b09c41bef7', 'request_id': 'req-c588d768-74c3-4242-8333-e01b66a3443e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.894993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aca89227a643c2aba4f4b09c41bef7', 'request_id': 'req-c588d768-74c3-4242-8333-e01b66a3443e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.912025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] The token cache is being invalidate because project b1aca89227a643c2aba4f4b09c41bef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:29:54.912332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.912993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-c588d768-74c3-4242-8333-e01b66a3443e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:54.915019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1139/2321] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:29:54 2022] DELETE /identity/v3/projects/b1aca89227a643c2aba4f4b09c41bef7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:54.921664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:54.922400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:54.922873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:54.985992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:54.987208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:55.051338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:55.064311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1183/2322] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:55.072893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.073287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.073577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.098145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:55.099795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:55.116563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1140/2323] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:55.116897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.129823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d712d8-3b27-4f12-b8ac-68e353964440 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.134637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.135557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.135926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.136399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.138729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:29:55.139200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.140895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.161646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1184/2324] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:29:55.167086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.177809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82dd4d-cd42-4c34-8389-c3dc3345c279 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.193788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2464b-be90-4753-9877-634969364093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.194493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2464b-be90-4753-9877-634969364093 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.194767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2464b-be90-4753-9877-634969364093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.195049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2464b-be90-4753-9877-634969364093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.196927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2464b-be90-4753-9877-634969364093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.199951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2464b-be90-4753-9877-634969364093 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.238939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1141/2325] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:29:55 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:55.244516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.257676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ce410-aa68-479e-bc44-87dd547ee1b9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.365896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.366053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.366342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.366630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.376524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.378781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.413404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1185/2326] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:29:55 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:29:55.417947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2464b-be90-4753-9877-634969364093 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.429333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2464b-be90-4753-9877-634969364093 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.434629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.435754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.436105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.436448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.437254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.439056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.451132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1142/2327] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:55.455958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.473184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492ccb3-9e77-411f-8e79-2284ba304210 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.476655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.477611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.478062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.480051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.480828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.482444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f7183-d4d2-4860-8dd1-94c8eb8dbb2e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.493410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1186/2328] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:29:55.498015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.511263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d099f83-5c58-4151-a9f2-5a2a86f28e9d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.520141 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.521391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.521930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.522410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] PATH_INFO: `/v3/projects/594f20f8638947e4b9560a8b21082720/users/b5e1d07ece264f41af77f51dbb04814c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.541601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:55.546491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594f20f8638947e4b9560a8b21082720, user_id=b5e1d07ece264f41af77f51dbb04814c, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.549485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.565026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1143/2329] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:29:55 2022] PUT /identity/v3/projects/594f20f8638947e4b9560a8b21082720/users/b5e1d07ece264f41af77f51dbb04814c/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:55.576080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.576374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.576660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.604185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] MFA Rules not processed for user `b5e1d07ece264f41af77f51dbb04814c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:29:55.605400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:55.669397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1187/2330] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:29:55.681450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:55.683203 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:29:55.742250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c88bfc-bd92-4d18-996e-6927dbdb9702 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:55.746248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:55.746894 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:55.747179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:55.747498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:55.755925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:55.757359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314e67d-892c-4c01-a193-bde8ce20bc2f service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:55.766672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1144/2331] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:29:59.835459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:29:59.888541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:29:59.900912 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd437e-e17c-4b3b-a66c-0a885e13d371 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:29:59.905488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:29:59.906361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:59.906671 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:59.907150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] PATH_INFO: `/v3/users/b5e1d07ece264f41af77f51dbb04814c` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:29:59.908441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e1d07ece264f41af77f51dbb04814c)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:29:59.910378 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:29:59.957935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e1d07ece264f41af77f51dbb04814c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:59.970291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e1d07ece264f41af77f51dbb04814c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:59.978045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e1d07ece264f41af77f51dbb04814c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:59.978663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e1d07ece264f41af77f51dbb04814c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:59.985817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e1d07ece264f41af77f51dbb04814c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:29:59.992022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1188/2332] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:29:59 2022] DELETE /identity/v3/users/b5e1d07ece264f41af77f51dbb04814c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:29:59.996703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:29:59.997169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:29:59.997326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.015246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:00.016466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.080242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1145/2333] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:00.090594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.092276 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.181273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f1d66-67ab-4c61-8df8-25b8a50dda77 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.185284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:00.186003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.186288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.186566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.201281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:00.202705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea000ec4-6559-4b4a-92de-5133946d8d47 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:00.212843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1189/2334] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:30:00.475121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.477355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.490068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a58583-f6f5-4bab-896c-1f8d0a30ef0e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.495836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:00.496720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.497009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.497290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] PATH_INFO: `/v3/projects/594f20f8638947e4b9560a8b21082720` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.498531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=594f20f8638947e4b9560a8b21082720)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:00.500511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:00.549378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594f20f8638947e4b9560a8b21082720', 'request_id': 'req-70a32632-9817-46c8-a214-5478938aa829'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.557364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594f20f8638947e4b9560a8b21082720', 'request_id': 'req-70a32632-9817-46c8-a214-5478938aa829'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.564106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594f20f8638947e4b9560a8b21082720', 'request_id': 'req-70a32632-9817-46c8-a214-5478938aa829'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.578184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] The token cache is being invalidate because project 594f20f8638947e4b9560a8b21082720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:00.578184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.578840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-70a32632-9817-46c8-a214-5478938aa829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.580660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1146/2335] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:00 2022] DELETE /identity/v3/projects/594f20f8638947e4b9560a8b21082720 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:00.585367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.585731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.586037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.620691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:00.622085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.676310 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:00.690995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1190/2336] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:00.700358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.700652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.701175 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.724993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:00.726770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.736357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.737848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.742206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1147/2337] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:00.743424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.755853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bfc98-ba04-4686-b009-2c1c1419464b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.759544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca496c-f85d-4331-8e0a-897f3b9e6a84 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.770931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:00.771644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.771929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.772206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.772954 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:30:00.774171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:00.775838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:00.777627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:00.778645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:00.779989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.780182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.780446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] PATH_INFO: `/v3/users/ebadff03d4684c3f8fd95001ee1b7ffc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.782008 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebadff03d4684c3f8fd95001ee1b7ffc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:00.784757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:00.795416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1148/2338] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:30:00.801713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.813855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb769f-e3fc-48cb-b5f1-ff110a2a5577 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.819825 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:00.823391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:00.823391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:00.823391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:00.823391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:00.824248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:00.870278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1149/2339] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:30:00 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:00.871898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.872417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebadff03d4684c3f8fd95001ee1b7ffc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.893303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebadff03d4684c3f8fd95001ee1b7ffc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.907204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebadff03d4684c3f8fd95001ee1b7ffc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.908183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebadff03d4684c3f8fd95001ee1b7ffc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.916534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebadff03d4684c3f8fd95001ee1b7ffc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:00.923291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1191/2340] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:00 2022] DELETE /identity/v3/users/ebadff03d4684c3f8fd95001ee1b7ffc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:00.924258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:00.925617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:00.946566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bfb99-ab8f-4e62-bb83-4664e5936d7c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:00.996122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766768d3-66af-4f14-8465-e0fe19ccb4f5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.001409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.002358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.002820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.003219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] PATH_INFO: `/v3/users/d33828e71df04f92a89030bcb9b2ceb9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.004787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33828e71df04f92a89030bcb9b2ceb9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.005392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.006090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.006376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.006683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.007083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.008190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.010041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57afe2-5ec1-4d42-84db-739948a6d257 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.030974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1150/2341] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:30:00 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:01.032884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.032884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.033252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.052594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:01.053813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.059881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33828e71df04f92a89030bcb9b2ceb9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:01.062693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1151/2342] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:01.063572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.065109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.073210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33828e71df04f92a89030bcb9b2ceb9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:01.077410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1af1b-4b77-4bc8-a421-34d485a5d444 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.077880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:01.082344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33828e71df04f92a89030bcb9b2ceb9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:01.082502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.083016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.083298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.083617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.083737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33828e71df04f92a89030bcb9b2ceb9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:01.084393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.086900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.093513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33828e71df04f92a89030bcb9b2ceb9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:01.099443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1152/2343] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:01.099443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.099858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.102792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1192/2344] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:00 2022] DELETE /identity/v3/users/d33828e71df04f92a89030bcb9b2ceb9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:01.103725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.105266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.159770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1544-e54a-402d-b1a2-98ad9a67142d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.163509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:01.175689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3848-6a65-4931-b235-59be9e4db53a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.181308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.182001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.182329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.182611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.183623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.185246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49ba6f-bbd3-4cbd-ba79-607d27c228e1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.200905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1193/2345] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:01.205414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.205740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.206156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.217492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.218150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.218439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.218717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.220728 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.233301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:01.234445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.244082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.248857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.248992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1194/2346] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:01.248992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.257449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43339642-1764-4587-8530-aafd9d5fc8f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.262043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1153/2347] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:01.262698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.263104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.263735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.264024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.264303 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] PATH_INFO: `/v3/projects/8ec4c4c1d8f948f9a29ffbb11c21e996/users/eaf1ccab6111420d8ba092440e108af8/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.275789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941224cc-c7f7-44bf-8f1f-27a6952885fe service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.282697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.283415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.283678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.283951 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.289832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4c4c1d8f948f9a29ffbb11c21e996, user_id=eaf1ccab6111420d8ba092440e108af8, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.295575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.295825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.300553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7d7c9-bdf0-4e01-8768-0a35240198c4 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.315442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1154/2348] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:01.327830 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1195/2349] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:30:01 2022] PUT /identity/v3/projects/8ec4c4c1d8f948f9a29ffbb11c21e996/users/eaf1ccab6111420d8ba092440e108af8/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:01.338727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.339014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.339292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.373092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] MFA Rules not processed for user `eaf1ccab6111420d8ba092440e108af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:01.374410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.448843 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1155/2350] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:01.461924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.464119 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.546185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5dfe-2511-4ced-9083-6b0ded8fb479 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.550105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.550761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.551061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.551337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.560900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.562215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:01.572271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1196/2351] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:30:01.850600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.852266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.873582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:01.875233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:01.962032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe6957-b1f2-42c2-af31-fac6fdc97a73 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:01.977648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:01.978757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:01.979126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:01.979944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] PATH_INFO: `/v3/projects/1f4c34e9edec430eb37d05598bcdbc09` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:01.981779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4c34e9edec430eb37d05598bcdbc09)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:01.983817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.002086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:02.010101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa038731-def6-4519-8bb4-df828f1e4de1 service glance] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.020585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.021600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.022035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.022333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] PATH_INFO: `/v3/projects/2322168a437449a0b10396724b5a3d0b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.029082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2322168a437449a0b10396724b5a3d0b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.029603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:02.031162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.058072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4c34e9edec430eb37d05598bcdbc09', 'request_id': 'req-96e6d407-1303-4858-afb0-d471f6d0e3b6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.072595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4c34e9edec430eb37d05598bcdbc09', 'request_id': 'req-96e6d407-1303-4858-afb0-d471f6d0e3b6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.083464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4c34e9edec430eb37d05598bcdbc09', 'request_id': 'req-96e6d407-1303-4858-afb0-d471f6d0e3b6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.098822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2322168a437449a0b10396724b5a3d0b', 'request_id': 'req-59817f30-052d-4b48-b830-b22e86dbe5e8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.105069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] The token cache is being invalidate because project 1f4c34e9edec430eb37d05598bcdbc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:02.105971 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.107346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-96e6d407-1303-4858-afb0-d471f6d0e3b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.107668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2322168a437449a0b10396724b5a3d0b', 'request_id': 'req-59817f30-052d-4b48-b830-b22e86dbe5e8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.110305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1156/2352] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:01 2022] DELETE /identity/v3/projects/1f4c34e9edec430eb37d05598bcdbc09 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:02.116162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2322168a437449a0b10396724b5a3d0b', 'request_id': 'req-59817f30-052d-4b48-b830-b22e86dbe5e8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.117977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.119288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.119760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.139309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] The token cache is being invalidate because project 2322168a437449a0b10396724b5a3d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:02.139309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.143780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:02.145168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:02.149407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-59817f30-052d-4b48-b830-b22e86dbe5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:02.152429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1197/2353] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:01 2022] DELETE /identity/v3/projects/2322168a437449a0b10396724b5a3d0b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:02.261274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1157/2354] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:02.270121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.270457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.270688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.291998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:02.293250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:02.301653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1198/2355] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:02.307043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.318302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1942a-84c8-44fb-9896-8b48e2c2d075 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.323875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.324641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.324929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.325209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.325978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:30:02.326292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.328005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.344776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1158/2356] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:30:02.345813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.356183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6ead-6b6d-40ce-be1a-a82ae540fc67 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.361069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.361767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.362052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.362351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.363090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.365298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.403840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1199/2357] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:30:02 2022] POST /identity/v3/projects => generated 397 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:02.405034 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.416659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93ca68-09dd-4d05-af78-3d2395e6dd3a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.489958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.490641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.490927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.491318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.492068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.494162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.520216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1159/2358] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:30:02 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:02.525334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.535894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750ee62-7a84-4fdc-9636-f584d247b4a8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.540943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.541667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.541957 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.542242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.542974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.544676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.556386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1200/2359] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:30:02.560775 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.572020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f95c-b8f4-45c1-9cdf-814d45cb1eb2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.576857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.577733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.578809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.578809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.579060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.580715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd8536-9ee8-45b2-81f1-5622e27a19d4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.591885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1160/2360] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:02.596230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.606397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa59714-e193-4296-a584-423ce7aa7958 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.611165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.612117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.612404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.612682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] PATH_INFO: `/v3/projects/8799b147b5df4c8081ae1a8ce789fb68/users/065c222e90bf46eb8f09935f7a8f0021/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.628326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8799b147b5df4c8081ae1a8ce789fb68, user_id=065c222e90bf46eb8f09935f7a8f0021, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.631257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.645485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1201/2361] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:30:02 2022] PUT /identity/v3/projects/8799b147b5df4c8081ae1a8ce789fb68/users/065c222e90bf46eb8f09935f7a8f0021/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:02.657471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.657766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.658035 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.696227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] MFA Rules not processed for user `065c222e90bf46eb8f09935f7a8f0021`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:02.697346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:02.707642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:02.769442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1161/2362] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:02.782742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:02.784600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:02.853622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b19b4-00df-4782-ac1d-43ccb81694f6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:02.857298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:02.857953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:02.858242 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:02.858525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:02.867498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:02.868933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9eace-2790-480e-b13a-ccac7785913a service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:02.878498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1202/2363] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:30:03.536802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:03.538862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:03.604660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97ef7-bae9-41f4-8ee3-75d7b9a9d48d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:03.609245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:03.610103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:03.610384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:03.610654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] PATH_INFO: `/v3/users/c1c6b18b425944e7bf96a91df82774d4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:03.611880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c6b18b425944e7bf96a91df82774d4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:03.613808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:03.658953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c6b18b425944e7bf96a91df82774d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:03.667403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c6b18b425944e7bf96a91df82774d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:03.681964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c6b18b425944e7bf96a91df82774d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:03.682675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c6b18b425944e7bf96a91df82774d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:03.690464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c6b18b425944e7bf96a91df82774d4'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:03.697228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1162/2364] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:03 2022] DELETE /identity/v3/users/c1c6b18b425944e7bf96a91df82774d4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:03.701789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:03.702077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:03.702516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:03.720737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:03.721938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:03.741877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:03.785655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1203/2365] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:03.796464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:03.798227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:03.844942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:03.872684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240303a-d048-42d0-8b60-e39c37959394 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:03.878148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:03.879009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:03.879392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:03.879662 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:03.890273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:03.892528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a2dc9-9083-4a45-bc3f-93654d5f2b28 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:03.905055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1163/2366] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:04.213067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.214882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:04.230322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5e7b-482b-4843-86d1-c5be215b3d20 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.236150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.237308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.237608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.238090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] PATH_INFO: `/v3/projects/66584fa94e5d4da0bb2c441d13f0f240` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.239636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66584fa94e5d4da0bb2c441d13f0f240)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.242675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.293308 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66584fa94e5d4da0bb2c441d13f0f240', 'request_id': 'req-9457feef-a6a4-45dc-ab71-412d7033c237'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:04.298989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66584fa94e5d4da0bb2c441d13f0f240', 'request_id': 'req-9457feef-a6a4-45dc-ab71-412d7033c237'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:04.306530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66584fa94e5d4da0bb2c441d13f0f240', 'request_id': 'req-9457feef-a6a4-45dc-ab71-412d7033c237'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:04.318749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] The token cache is being invalidate because project 66584fa94e5d4da0bb2c441d13f0f240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:04.319794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:04.320646 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9457feef-a6a4-45dc-ab71-412d7033c237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:04.322321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1204/2367] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:04 2022] DELETE /identity/v3/projects/66584fa94e5d4da0bb2c441d13f0f240 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:04.327912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.328229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.328531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.358704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:04.360001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:04.435820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1164/2368] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:04.443632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39954f-4074-4210-a717-494a747090e7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.443923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39954f-4074-4210-a717-494a747090e7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.444706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39954f-4074-4210-a717-494a747090e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.469686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6c39954f-4074-4210-a717-494a747090e7 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:04.470898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c39954f-4074-4210-a717-494a747090e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:04.479026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1205/2369] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:30:04.483615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.494189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b964d7-a1d5-4c54-8753-1e105edbc44b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.503855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.504931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.507469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.507999 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.508767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:30:04.509086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.510736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.529752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1165/2370] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:30:04.530899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39954f-4074-4210-a717-494a747090e7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.540844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39954f-4074-4210-a717-494a747090e7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.546446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.547135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.547470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.547763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.548498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.550649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.590591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1206/2371] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:30:04 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:04.595642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.609094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634539a-c265-4545-9bfa-f6750f52a057 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.693263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.693965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.694767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.695042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.695779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.697735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.719549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1166/2372] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:30:04 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:30:04.723795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.735054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb2ea-1728-4083-a476-9fc61d52de32 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.739863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.740521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.740836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.741222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.741947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.743563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.753838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1207/2373] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:04.758109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.768441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71362d6-f270-4d04-a1ad-52be30758c86 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.774041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.774719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.775072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.775345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.776093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.777719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabea6d-2f60-4df8-9362-a22272c22dc3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.790741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1167/2374] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:04.794837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.804908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d928-929e-4cb8-9e89-a2ed8afca02b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:04.810129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:04.811074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.811356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.811688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] PATH_INFO: `/v3/projects/6820662c81674e78816d360dbfa3ce2d/users/c60e4f20edd74ff397ca3d2a5849d371/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.828415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6820662c81674e78816d360dbfa3ce2d, user_id=c60e4f20edd74ff397ca3d2a5849d371, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:04.831064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:04.847106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1208/2375] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:30:04 2022] PUT /identity/v3/projects/6820662c81674e78816d360dbfa3ce2d/users/c60e4f20edd74ff397ca3d2a5849d371/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:04.862172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:04.862492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:04.862777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:04.891003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] MFA Rules not processed for user `c60e4f20edd74ff397ca3d2a5849d371`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:04.892277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:04.911698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:04.959244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1168/2376] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:04.971641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:04.973422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:05.020833 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:05.035857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf90cc4-f50a-4af0-acab-4c90f3636985 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:05.040358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:05.041074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:05.041400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:05.041815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:05.051739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:05.053279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74107-578b-40e7-b39f-0aca8834d883 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:05.062495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1209/2377] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:08.007658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:08.009656 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:08.091330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4448d-1ded-48d2-a9b8-1409a699801b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:08.096795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:08.097777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:08.098059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:08.098432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] PATH_INFO: `/v3/users/065c222e90bf46eb8f09935f7a8f0021` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:08.100952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065c222e90bf46eb8f09935f7a8f0021)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:08.103339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:08.173461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065c222e90bf46eb8f09935f7a8f0021'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.181642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065c222e90bf46eb8f09935f7a8f0021'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.194803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065c222e90bf46eb8f09935f7a8f0021'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.195573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065c222e90bf46eb8f09935f7a8f0021'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.203531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065c222e90bf46eb8f09935f7a8f0021'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.210633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1169/2378] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:08 2022] DELETE /identity/v3/users/065c222e90bf46eb8f09935f7a8f0021 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:08.215238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:08.215716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:08.215865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:08.246283 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:08.247812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:08.314488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1210/2379] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:08.324586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:08.326026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:08.370609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:08.385731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d06f-b188-4074-9a2e-0e8c1da65563 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:08.389693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:08.390365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:08.390644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:08.390914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:08.401445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:08.402879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:08.413723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1170/2380] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:08.692545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:08.694782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:08.720387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1be58-790c-4cb5-b87f-d15c7d5632aa None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:08.726785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:08.727899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:08.728253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:08.728598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] PATH_INFO: `/v3/projects/8799b147b5df4c8081ae1a8ce789fb68` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:08.730495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8799b147b5df4c8081ae1a8ce789fb68)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:08.732825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:08.800336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8799b147b5df4c8081ae1a8ce789fb68', 'request_id': 'req-83751a72-20b5-4040-a21d-d45f21c779f6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.806172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8799b147b5df4c8081ae1a8ce789fb68', 'request_id': 'req-83751a72-20b5-4040-a21d-d45f21c779f6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.814268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8799b147b5df4c8081ae1a8ce789fb68', 'request_id': 'req-83751a72-20b5-4040-a21d-d45f21c779f6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.826650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] The token cache is being invalidate because project 8799b147b5df4c8081ae1a8ce789fb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:08.826972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.827605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83751a72-20b5-4040-a21d-d45f21c779f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:08.829173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1211/2381] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:08 2022] DELETE /identity/v3/projects/8799b147b5df4c8081ae1a8ce789fb68 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:14.994725 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:14.996389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:15.010149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa90a-06c8-44fa-8986-392b8385a91b service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:15.071054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:15.072497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:15.072789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:15.073063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] PATH_INFO: `/v3/users/c60e4f20edd74ff397ca3d2a5849d371` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:15.074294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60e4f20edd74ff397ca3d2a5849d371)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:15.076301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:15.126057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60e4f20edd74ff397ca3d2a5849d371'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.133873 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60e4f20edd74ff397ca3d2a5849d371'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.145537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60e4f20edd74ff397ca3d2a5849d371'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.146207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60e4f20edd74ff397ca3d2a5849d371'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.153407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60e4f20edd74ff397ca3d2a5849d371'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.159674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1171/2382] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:14 2022] DELETE /identity/v3/users/c60e4f20edd74ff397ca3d2a5849d371 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:15.164188 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:15.164709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:15.164856 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:15.182929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:15.184158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:15.245552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1212/2383] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:15.255960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:15.257376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:15.317895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27a81e-59aa-46fb-9126-896a99ba62d8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:15.321697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:15.322357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:15.322639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:15.322911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:15.332644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:15.334132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502135f2-c15c-484b-b58e-600286f83a45 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:15.343809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1172/2384] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:15.630067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:15.631815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:15.643672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2b95b-c347-4311-84cc-a86bcb40e291 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:15.648828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:15.649650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:15.649929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:15.650200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] PATH_INFO: `/v3/projects/6820662c81674e78816d360dbfa3ce2d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:15.651418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6820662c81674e78816d360dbfa3ce2d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:15.655390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:15.659953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:15.712493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6820662c81674e78816d360dbfa3ce2d', 'request_id': 'req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.718431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6820662c81674e78816d360dbfa3ce2d', 'request_id': 'req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.729117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6820662c81674e78816d360dbfa3ce2d', 'request_id': 'req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.742124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] The token cache is being invalidate because project 6820662c81674e78816d360dbfa3ce2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:15.742416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.743674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:15.745252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1213/2385] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:15 2022] DELETE /identity/v3/projects/6820662c81674e78816d360dbfa3ce2d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:25.339548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:25.738284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:37.405651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20843031-263e-4d9f-aff7-0f39f28a6b52 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:37.406854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20843031-263e-4d9f-aff7-0f39f28a6b52 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:37.407068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20843031-263e-4d9f-aff7-0f39f28a6b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:37.444829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-20843031-263e-4d9f-aff7-0f39f28a6b52 None None] MFA Rules not processed for user `74d565ebc4f141728964939ad751eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:37.446527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-20843031-263e-4d9f-aff7-0f39f28a6b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:37.523501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1173/2386] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:42.469061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:42.470620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:42.537257 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b92c-876f-40ed-8ac2-3c4fe46ce359 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:42.542406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:42.543296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:42.543614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:42.543885 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] PATH_INFO: `/v3/users/4e01c2b4c0b54ac4b199e224d6d8fe8b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:42.545098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e01c2b4c0b54ac4b199e224d6d8fe8b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:42.547556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:42.597006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e01c2b4c0b54ac4b199e224d6d8fe8b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:42.609470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e01c2b4c0b54ac4b199e224d6d8fe8b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:42.616551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e01c2b4c0b54ac4b199e224d6d8fe8b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:42.617254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e01c2b4c0b54ac4b199e224d6d8fe8b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:42.625611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e01c2b4c0b54ac4b199e224d6d8fe8b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:42.632262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1214/2387] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:42 2022] DELETE /identity/v3/users/4e01c2b4c0b54ac4b199e224d6d8fe8b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:42.636950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:42.637455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:42.637559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:42.657110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:42.658434 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:42.722867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1174/2388] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:42.732622 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:42.734633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:42.797657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ac33c-c678-4a17-91a9-8b03587020ef admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:42.801761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:42.802425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:42.802712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:42.802990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:42.813679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:42.815094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0aaf6-9dac-4024-b61d-b01a3883f9cd service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:42.828324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1215/2389] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:43.126901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.128514 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:43.153467 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a4828-d5f5-49e5-aa54-0496c5b0eea8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.159820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.161082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.161372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.161710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] PATH_INFO: `/v3/projects/0fc9efb0d4ac4ac18b16e6287a636c72` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.162965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc9efb0d4ac4ac18b16e6287a636c72)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.165126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.228783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc9efb0d4ac4ac18b16e6287a636c72', 'request_id': 'req-a213a146-f772-4523-bd86-badd9384948d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:43.237598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc9efb0d4ac4ac18b16e6287a636c72', 'request_id': 'req-a213a146-f772-4523-bd86-badd9384948d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:43.244278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc9efb0d4ac4ac18b16e6287a636c72', 'request_id': 'req-a213a146-f772-4523-bd86-badd9384948d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:43.257786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] The token cache is being invalidate because project 0fc9efb0d4ac4ac18b16e6287a636c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:43.258109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:43.258747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a213a146-f772-4523-bd86-badd9384948d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:43.260371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1175/2390] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:43 2022] DELETE /identity/v3/projects/0fc9efb0d4ac4ac18b16e6287a636c72 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:43.266297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.266687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.267035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.297723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:43.298963 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:43.318565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:43.375654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1216/2391] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:30:43.383779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.384074 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.384353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.403865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:43.405688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:43.415666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1176/2392] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:43.420039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.432987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b038ac-505f-4024-a3ea-40cbc2a32f23 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.438344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.439021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.439384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.439673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.440403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:30:43.440720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.442375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.458889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1217/2393] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:30:43.460790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.472246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac82e-4926-44df-92f5-48514a79b003 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.481557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.482178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.482464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.482908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.483690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.485792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.512659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:43.528537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.537782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1177/2394] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:30:43 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:43.546362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08577f6a-a9e1-4e3b-9141-f48ff0117aad admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.632125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.632887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.633179 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.633461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.634264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.636650 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.660801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1218/2395] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:30:43 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:30:43.665038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.681207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138fdd7-533c-46d1-aaec-c060ce1119e9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.687243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.688037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.688342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.688623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.689410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.691055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.705232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1178/2396] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:43.709594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.721979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b10f6-c915-4044-a024-0573be03372e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.726014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.726695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.726989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.727270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.728852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.730543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec197e2b-0eb4-4e7e-b073-1ebe467e023a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.743050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1219/2397] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:30:43.748010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.759441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163052d-6d49-45d7-bd81-e176c834e7ad admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:43.764572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:43.765472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.765755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.766059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] PATH_INFO: `/v3/projects/173879c7e138445bba1324143f0fafe6/users/4f464e3d409d4f2fa0a217c29e92fa3e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.781471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173879c7e138445bba1324143f0fafe6, user_id=4f464e3d409d4f2fa0a217c29e92fa3e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:43.784382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:43.798956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1179/2398] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:30:43 2022] PUT /identity/v3/projects/173879c7e138445bba1324143f0fafe6/users/4f464e3d409d4f2fa0a217c29e92fa3e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:43.810457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53734-eec7-4396-be43-7dec5b6b2662 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:43.810786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53734-eec7-4396-be43-7dec5b6b2662 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:43.811093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53734-eec7-4396-be43-7dec5b6b2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:43.842362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-86e53734-eec7-4396-be43-7dec5b6b2662 None None] MFA Rules not processed for user `4f464e3d409d4f2fa0a217c29e92fa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:43.843637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-86e53734-eec7-4396-be43-7dec5b6b2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:43.913694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1220/2399] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:43.928115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:43.929816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:44.012901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69705a-5191-4278-9da3-bee4063f9d60 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:44.016796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:44.017442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:44.017724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:44.017997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:44.026589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:44.028072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:44.038070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1180/2400] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:45.449881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560716b1-6684-408d-bb33-50fb8a3adf05 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:45.450262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560716b1-6684-408d-bb33-50fb8a3adf05 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:45.450554 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560716b1-6684-408d-bb33-50fb8a3adf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:45.469034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-560716b1-6684-408d-bb33-50fb8a3adf05 None None] MFA Rules not processed for user `4f464e3d409d4f2fa0a217c29e92fa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:45.470335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-560716b1-6684-408d-bb33-50fb8a3adf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:45.478026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1221/2401] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:50.518490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:50.519922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:50.584253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf391d92-33b1-4923-8c6e-d0c54031ec10 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:50.589007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:50.589888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:50.590172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:50.590443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] PATH_INFO: `/v3/users/eaf1ccab6111420d8ba092440e108af8` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:50.592327 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf1ccab6111420d8ba092440e108af8)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:50.594273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:50.647152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf1ccab6111420d8ba092440e108af8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:50.649806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:50.658173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf1ccab6111420d8ba092440e108af8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:50.676819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf1ccab6111420d8ba092440e108af8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:50.677903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf1ccab6111420d8ba092440e108af8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:50.688618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf1ccab6111420d8ba092440e108af8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:50.695731 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1181/2402] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:50 2022] DELETE /identity/v3/users/eaf1ccab6111420d8ba092440e108af8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:50.701120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:50.701640 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:50.701812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:50.720216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:50.721487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:50.727444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:50.794693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1222/2403] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:50.806046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:50.807494 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:50.874841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc500ad5-285a-4602-92e1-b7e9daffe5de admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:50.878788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:50.879518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:50.879817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:50.880102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:50.890275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:50.891786 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77844cc-1248-42bf-bed4-f8b0cffb723c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:50.901874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1182/2404] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:51.288872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.290409 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:51.303911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddf6b-e264-4605-b7fd-7b13299d944e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.310406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.311324 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.311676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.311986 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] PATH_INFO: `/v3/projects/8ec4c4c1d8f948f9a29ffbb11c21e996` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.316295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec4c4c1d8f948f9a29ffbb11c21e996)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.318316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.367220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec4c4c1d8f948f9a29ffbb11c21e996', 'request_id': 'req-40f6d4e9-6250-49c0-9bd4-f27727787c25'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:51.373591 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec4c4c1d8f948f9a29ffbb11c21e996', 'request_id': 'req-40f6d4e9-6250-49c0-9bd4-f27727787c25'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:51.381526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec4c4c1d8f948f9a29ffbb11c21e996', 'request_id': 'req-40f6d4e9-6250-49c0-9bd4-f27727787c25'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:51.393366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] The token cache is being invalidate because project 8ec4c4c1d8f948f9a29ffbb11c21e996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:51.393653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:51.394298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-40f6d4e9-6250-49c0-9bd4-f27727787c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:51.395879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1223/2405] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:51 2022] DELETE /identity/v3/projects/8ec4c4c1d8f948f9a29ffbb11c21e996 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:51.400625 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.400910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.401182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.420314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:51.421560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:51.490276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1183/2406] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:51.498991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.499280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.499593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.518201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:51.519446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:51.527465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1224/2407] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:51.532269 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.542892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f037fb-64b6-4e80-9195-2b8bde8fad51 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.548685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.550011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.550301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.550578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.551348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:30:51.551693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.553397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.567247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1184/2408] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:30:51.571647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.581917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a929413-8e8c-452c-8d97-ccc6924a9ac8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.586709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.587441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.587730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.588003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.588715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.590659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.622794 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1225/2409] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:30:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:51.624065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.634726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3deb-f5b1-4a2e-8fa8-c6d2fabfb59b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.693278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:51.702351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.703233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.703639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.704369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.705344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.707644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.728839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1185/2410] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:30:51 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:30:51.733638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.744293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb151d-b3fb-4a50-8758-c43bd7cfdc75 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.749564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.750253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.750553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.750819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.751594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.753203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.764919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1226/2411] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:30:51.769179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.781227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd8b1a-c651-47b0-ac1c-2801c3356d71 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.786381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.787153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.787552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.787902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.788744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.790477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1b393-d76b-4238-bf7e-59ef46f83249 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.806378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1186/2412] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:30:51.808049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:51.819557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a1ac-ca8d-4816-a301-1d97760a7d9c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:51.824864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:51.825836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.826148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.826386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] PATH_INFO: `/v3/projects/53e5ac46cf304e34a410089d905ec992/users/9d071c4354da4617a0882e01599a544a/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.842678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e5ac46cf304e34a410089d905ec992, user_id=9d071c4354da4617a0882e01599a544a, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:51.845500 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:51.861579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1227/2413] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:30:51 2022] PUT /identity/v3/projects/53e5ac46cf304e34a410089d905ec992/users/9d071c4354da4617a0882e01599a544a/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:51.873994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:51.874438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:51.874792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:51.906245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] MFA Rules not processed for user `9d071c4354da4617a0882e01599a544a`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:51.908890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:51.985709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1187/2414] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:30:51.998339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:52.000453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:52.037386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:52.065331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06420d-4d8f-4e54-bb38-a7653d4dfff7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:52.069078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:52.069787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:52.070015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:52.070291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:52.079258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:52.080717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c771051-8887-4e7b-8619-2b3acfe47e01 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:52.089917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1228/2415] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:54.660850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:54.729217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290456b-0e15-4d49-b15b-85befb0ccc6d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:54.734076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:54.734974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:54.735260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:54.735637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] PATH_INFO: `/v3/users/9d071c4354da4617a0882e01599a544a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:54.736869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d071c4354da4617a0882e01599a544a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:54.738827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:54.793237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d071c4354da4617a0882e01599a544a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:54.805108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d071c4354da4617a0882e01599a544a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:54.828826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:30:54.835394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d071c4354da4617a0882e01599a544a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:54.836477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d071c4354da4617a0882e01599a544a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:54.845451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d071c4354da4617a0882e01599a544a'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:54.852364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1188/2416] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:30:54 2022] DELETE /identity/v3/users/9d071c4354da4617a0882e01599a544a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:30:54.858085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:54.858940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:54.859398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:54.883770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:30:54.884972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:54.945609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1229/2417] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:30:54.955292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:54.956708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:55.013800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17c787-6d77-4683-a51f-b72e0be7b59e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:55.017377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:55.018019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:55.018300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:55.018576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:55.027429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:55.029017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6132a-39b8-4338-9ec7-ead7bbff4ee1 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:55.038255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1189/2418] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:30:55.299184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:30:55.301064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:30:55.313757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cbe27-d197-442c-a139-22bf6baa1bad None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:30:55.318563 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:30:55.319499 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:30:55.319787 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:30:55.320062 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] PATH_INFO: `/v3/projects/53e5ac46cf304e34a410089d905ec992` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:30:55.321263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e5ac46cf304e34a410089d905ec992)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:30:55.323237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:30:55.370781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e5ac46cf304e34a410089d905ec992', 'request_id': 'req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:55.377296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e5ac46cf304e34a410089d905ec992', 'request_id': 'req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:55.384795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e5ac46cf304e34a410089d905ec992', 'request_id': 'req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:55.396530 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] The token cache is being invalidate because project 53e5ac46cf304e34a410089d905ec992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:30:55.396817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:55.397477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:30:55.399013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1230/2419] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:30:55 2022] DELETE /identity/v3/projects/53e5ac46cf304e34a410089d905ec992 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:31:02.754309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae19b-7399-4a25-ae1e-3f6e40e831a1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:02.754757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae19b-7399-4a25-ae1e-3f6e40e831a1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:02.754862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ae19b-7399-4a25-ae1e-3f6e40e831a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:02.825663 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d12ae19b-7399-4a25-ae1e-3f6e40e831a1 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:02.826896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d12ae19b-7399-4a25-ae1e-3f6e40e831a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:02.897355 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1190/2420] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:02.938135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:02.939651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:03.000673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:03.032471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcba1-4187-4dd7-9c0c-e72ebd3cf00f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:03.037467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:03.038117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:03.038404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:03.038683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:03.046763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:03.048632 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:03.056537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1231/2421] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:31:03.598770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744508-668c-41af-8ad0-d163a29d142f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:03.599058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744508-668c-41af-8ad0-d163a29d142f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:03.599331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744508-668c-41af-8ad0-d163a29d142f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:03.617892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-65744508-668c-41af-8ad0-d163a29d142f None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:03.619088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-65744508-668c-41af-8ad0-d163a29d142f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:03.627180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1191/2422] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:03.640658 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:03.651127 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa792-ed0a-40b6-b8b8-dcdfedfd2667 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:03.656508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:03.657146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:03.657507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:03.657786 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:03.667140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:03.669082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:03.677939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1232/2423] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:31:03.890174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee31-a1a8-46fc-8ec6-7d9909fce123 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:03.890635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee31-a1a8-46fc-8ec6-7d9909fce123 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:03.890732 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ee31-a1a8-46fc-8ec6-7d9909fce123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:03.908190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6709ee31-a1a8-46fc-8ec6-7d9909fce123 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:03.909368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6709ee31-a1a8-46fc-8ec6-7d9909fce123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:03.916469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1192/2424] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:03.929014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:03.940115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18874c-4e65-4ccd-9625-8d1f0aa188ff service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:03.945141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:03.945784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:03.946089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:03.946353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:03.954679 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:03.956271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:03.964492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1233/2425] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:31:04.294076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:04.294368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:04.294643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:04.314456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:04.315666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:04.322647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1193/2426] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:04.334919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:04.346147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e430-90da-4135-9fe7-b7dc69c5a1b3 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:04.351175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:04.351869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:04.352160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:04.352444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:04.361317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:04.362900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26fc39-6477-41cb-99db-ac26840f539d service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:04.370878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1234/2427] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:31:06.403720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:06.405132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:06.432719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:06.471902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c092dc-8f55-4f7b-8c45-25661a8f365b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:06.476378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:06.477241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:06.477519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:06.477790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] PATH_INFO: `/v3/users/4f464e3d409d4f2fa0a217c29e92fa3e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:06.479002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f464e3d409d4f2fa0a217c29e92fa3e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:06.481970 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:06.526178 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f464e3d409d4f2fa0a217c29e92fa3e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.533444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f464e3d409d4f2fa0a217c29e92fa3e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.545683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f464e3d409d4f2fa0a217c29e92fa3e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.546337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f464e3d409d4f2fa0a217c29e92fa3e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.553896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f464e3d409d4f2fa0a217c29e92fa3e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.559926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1194/2428] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:31:06 2022] DELETE /identity/v3/users/4f464e3d409d4f2fa0a217c29e92fa3e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:31:06.565065 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:06.565548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:06.565651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:06.582799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:06.584027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:06.643178 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1235/2429] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:31:06.653029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:06.654428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:06.713354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b0dc9-3306-4aa2-a43d-772f4b90569e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:06.717636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:06.718286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:06.718574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:06.718851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:06.727947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:06.729395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e093f-df10-42d0-a611-071763189f40 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:06.739753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1195/2430] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:31:06.904688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:06.906125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:06.918952 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042374ca-5a0c-45a4-ae1a-b7519aae6186 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:06.924123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38471067-a108-479a-8392-70c37493d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:06.925071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471067-a108-479a-8392-70c37493d987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:06.925423 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471067-a108-479a-8392-70c37493d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:06.925765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38471067-a108-479a-8392-70c37493d987 admin admin] PATH_INFO: `/v3/projects/173879c7e138445bba1324143f0fafe6` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:06.927924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38471067-a108-479a-8392-70c37493d987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173879c7e138445bba1324143f0fafe6)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:06.929944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38471067-a108-479a-8392-70c37493d987 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:06.990519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173879c7e138445bba1324143f0fafe6', 'request_id': 'req-38471067-a108-479a-8392-70c37493d987'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:06.996863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173879c7e138445bba1324143f0fafe6', 'request_id': 'req-38471067-a108-479a-8392-70c37493d987'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:07.004366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173879c7e138445bba1324143f0fafe6', 'request_id': 'req-38471067-a108-479a-8392-70c37493d987'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:07.015355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] The token cache is being invalidate because project 173879c7e138445bba1324143f0fafe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:31:07.015667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:07.016292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:31:07.017831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1236/2431] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:31:06 2022] DELETE /identity/v3/projects/173879c7e138445bba1324143f0fafe6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:31:16.735496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=68,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:17.012471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:41.561739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498194a3-56c5-46c8-8179-a4d52b031e02 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:41.562242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498194a3-56c5-46c8-8179-a4d52b031e02 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:41.562345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498194a3-56c5-46c8-8179-a4d52b031e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:41.580243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-498194a3-56c5-46c8-8179-a4d52b031e02 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:41.581444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-498194a3-56c5-46c8-8179-a4d52b031e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:41.639766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1196/2432] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:41.652331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:41.653826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:41.731559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38471067-a108-479a-8392-70c37493d987 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:41.736570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:41.737229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:41.737510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:41.737903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:41.747777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:41.749339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:41.759870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1237/2433] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:31:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:31:51.633149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=25 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:51.754124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:31:54.946443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:54.946939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:54.947040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:54.969573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] MFA Rules not processed for user `bf8e812b72a3456dbb303f0498b44334`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:54.970800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:55.025652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1197/2434] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:31:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:56.544610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:56.546010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:56.627165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:56.628642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:56.637780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ec33-fd37-49a5-8c76-60d9fbd30f11 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:56.642901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:56.643575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:56.643861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:56.644106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9facc4e-6592-4e33-a485-9ffab360fcc5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:56.644218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:56.645870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:56.649713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:56.650352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:56.650635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:56.650910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:56.658506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:56.659537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:56.660120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28393eb6-5e65-4ded-bb6b-d6569f80eb8b service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:56.661115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995fbe-a2f7-42a0-861f-8400c6d6d0ea service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:56.672293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1198/2435] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:31:56.672525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1238/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:31:57.903946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:57.904458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:57.904559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:57.905864 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1199/2437] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 23 15:31:57.911812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a211-2200-47f5-b725-47ad67648088 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:57.912250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a211-2200-47f5-b725-47ad67648088 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:57.912594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a211-2200-47f5-b725-47ad67648088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:57.965618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9af1a211-2200-47f5-b725-47ad67648088 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:57.966841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9af1a211-2200-47f5-b725-47ad67648088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:58.052193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1239/2438] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:31:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:58.064570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:58.066412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:58.151504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb07c-2c2b-4e8b-81ec-acf4387cd17f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:58.156003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:58.156661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.157001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.157280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.168658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:58.170098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ff61c-01a0-44ba-b31d-77470835e579 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:58.181638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1200/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:31:58.249903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.250201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.250485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.251922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1240/2440] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:31:58.256718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61534-4391-4151-a737-db1dad88659a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.257040 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61534-4391-4151-a737-db1dad88659a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.257324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd61534-4391-4151-a737-db1dad88659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.277196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4fd61534-4391-4151-a737-db1dad88659a None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:58.278334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4fd61534-4391-4151-a737-db1dad88659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:58.330696 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1201/2441] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:58.343208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:58.345003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:58.359003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10907f-30da-453d-8a5c-e5e4ebb0be67 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:58.362724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:58.363493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.363843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.364184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.372445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:58.373958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af92e6-d3e4-4a5f-9291-f435af9583bf service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:58.382474 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1241/2442] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:31:58.500543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbef4-8686-4a38-9b65-dae47a5660dc None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.500834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbef4-8686-4a38-9b65-dae47a5660dc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.501129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbbef4-8686-4a38-9b65-dae47a5660dc None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.502549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1202/2443] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:31:58.508088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dca1-2c6d-465f-b593-05b6ff0b7600 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.508490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dca1-2c6d-465f-b593-05b6ff0b7600 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.508855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28dca1-2c6d-465f-b593-05b6ff0b7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.532630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9d28dca1-2c6d-465f-b593-05b6ff0b7600 None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:31:58.534144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9d28dca1-2c6d-465f-b593-05b6ff0b7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:31:58.546021 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1242/2444] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:31:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:31:58.558693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbef4-8686-4a38-9b65-dae47a5660dc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:31:58.570446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbbef4-8686-4a38-9b65-dae47a5660dc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:31:58.574212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:31:58.574869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:31:58.575162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:31:58.575469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:31:58.591684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:31:58.593309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:31:58.606637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1203/2445] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:31:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:32:04.321093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cccc2-0589-4557-9753-8b4fe010627f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:32:04.321546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cccc2-0589-4557-9753-8b4fe010627f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:32:04.321686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cccc2-0589-4557-9753-8b4fe010627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:32:04.340084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b53cccc2-0589-4557-9753-8b4fe010627f None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:32:04.341271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b53cccc2-0589-4557-9753-8b4fe010627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:32:04.348438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1243/2446] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:32:04.372595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:32:04.384086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405fc50-35f9-4002-ad4e-25044e8d9e25 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:32:04.389107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:32:04.389754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:32:04.390037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:32:04.390315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:32:04.398603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:32:04.400241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:32:04.403972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=100 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:04.410632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1204/2447] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:32:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:32:14.334949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:14.407684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:27.685263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ec-862b-4fb9-a98d-d375e2270181 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:32:27.685815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ec-862b-4fb9-a98d-d375e2270181 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:32:27.685815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ec-862b-4fb9-a98d-d375e2270181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:32:27.724576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-288204ec-862b-4fb9-a98d-d375e2270181 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:32:27.726161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-288204ec-862b-4fb9-a98d-d375e2270181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:32:27.735537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1244/2448] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:32:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:32:27.757581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:32:27.768747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d52311-636f-4fde-bdba-8533b96d256f service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:32:27.775093 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:32:27.775793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:32:27.776075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:32:27.776349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:32:27.785266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:32:27.786854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:32:27.795968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1205/2449] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:32:37.715487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:37.792660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:32:58.633415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:32:58.633982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:32:58.633982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:32:58.651987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] MFA Rules not processed for user `74d565ebc4f141728964939ad751eca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:32:58.653211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:32:58.711777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1245/2450] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:33:08.705148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=25 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:45.734574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:45.736190 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:45.761376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8c16b-d5ea-4a99-97c4-3e15b147e758 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:45.767957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:45.768614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:45.768900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:45.769180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:45.770976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:45.830501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:45.832145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:45.841555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1206/2451] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:46.008392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:46.009779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:46.067595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6a4ac-e7be-4ff5-8c4d-d530eb135db4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:46.071162 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:46.071843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:46.072131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:46.072412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:46.074196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:46.087917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:46.089325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:46.100629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1246/2452] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:48.775408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:48.784816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd65ccd-4874-470d-8e14-effb476412d2 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:48.788549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:48.789200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:48.789472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:48.789747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:48.791590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:48.805098 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:48.806546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d5f97-9b86-4063-a5de-7db6769b915b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:48.818492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1207/2453] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:50.733860 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:50.745990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb96e-0f48-4dd5-8a5f-8396ce6b1701 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:50.766196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:50.767597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:50.768115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:50.768536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:50.771776 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:50.787481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:50.789395 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:50.823509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1247/2454] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:54.210292 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:54.210770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:54.210901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:54.228030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] MFA Rules not processed for user `4d86a6b64c22467d9852238e50122b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:33:54.229274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:54.236881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1208/2455] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:33:54.549136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:54.558350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c551ab0-cf94-4c60-8aa4-072931fbb936 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:54.562155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:54.562796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:54.563086 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:54.563384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:54.565206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:54.574789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:54.577085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:54.589555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1248/2456] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:54.918226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:54.938759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cefb4-dc5f-499d-aacb-3b89d84c2187 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:54.944237 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:54.944895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:54.945210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:54.945620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:54.948700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:54.961677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:54.963293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:54.974115 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1209/2457] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:33:56.681337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:33:56.682785 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:56.695489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017d7c-77bf-412b-89bd-51b7237d129e service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:33:56.699133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:33:56.699906 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:33:56.700255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:33:56.700597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:33:56.703207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:33:56.713851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:33:56.715298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:33:56.725222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1249/2458] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:04.969777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=43 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:05.073162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:05.087155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715054-a19d-454a-bb61-cda0d798e425 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:05.092749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:05.093393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:05.093671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:05.093942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:05.095722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:05.108588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:05.110248 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:05.121428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1210/2459] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:06.722019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=44 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:08.784559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:08.785971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:08.802250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2338dda-0b38-4000-a4e4-0167ec1e4280 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:08.812942 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:08.813620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:08.813899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:08.814202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:08.816045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:08.828990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:08.830561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cd382-66ca-4264-92e2-8ebdf69e6d65 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:08.842117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1250/2460] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:15.117021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:18.836670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:19.520189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:19.530025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adc7f6-b48d-4026-a711-30dbd978488d service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:19.533819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:19.534455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:19.534739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:19.535016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:19.536806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:19.548558 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:19.550007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:19.559738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1211/2461] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:21.979565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:21.980091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:21.980194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:21.998253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] MFA Rules not processed for user `bf8e812b72a3456dbb303f0498b44334`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:21.999490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:22.006496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1251/2462] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:34:22.312134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:22.321802 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac6ac-1710-4444-9313-eba5b4fcd442 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:22.326394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:22.327075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:22.327382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:22.327660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:22.329591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:22.339829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:22.341313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:22.349387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1212/2463] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:29.357517 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:29.369965 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3086-7f28-4f53-821c-989738a66182 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:29.376214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:29.376848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:29.377128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:29.377401 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:29.379158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:29.390003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:29.391583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:29.400616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1252/2464] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:32.345704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=12 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:39.396515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=9 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:40.770304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:40.785627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85935f6c-345a-4d2f-8937-98787609b3e9 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:40.789697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:40.790379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:40.790658 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:40.791122 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:40.793421 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:40.860870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:40.862332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:40.872405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1213/2465] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:45.048289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.049889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:45.065336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a97f4e-34fe-4ed2-88d6-b627fe7e6861 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.069898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.070773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.071054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.071328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] PATH_INFO: `/v3/users/74d565ebc4f141728964939ad751eca6` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.072651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d565ebc4f141728964939ad751eca6)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.075435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.121310 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d565ebc4f141728964939ad751eca6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.133091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d565ebc4f141728964939ad751eca6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.140672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d565ebc4f141728964939ad751eca6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.141347 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d565ebc4f141728964939ad751eca6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.148639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-beed05d9-503d-4272-94ab-c333c1febe1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d565ebc4f141728964939ad751eca6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.154975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1253/2466] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:34:45 2022] DELETE /identity/v3/users/74d565ebc4f141728964939ad751eca6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:34:45.328219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.339221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785d3ba-ac1a-43e7-8c54-e1b81bea6964 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.398207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.399065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.399344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.399644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] PATH_INFO: `/v3/projects/567ed4de4ecd444a8d86f2ef8328ac23` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.400830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567ed4de4ecd444a8d86f2ef8328ac23)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.403067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.449791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567ed4de4ecd444a8d86f2ef8328ac23', 'request_id': 'req-101f25ee-9fdd-4805-a8cb-c780fa664662'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.457182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567ed4de4ecd444a8d86f2ef8328ac23', 'request_id': 'req-101f25ee-9fdd-4805-a8cb-c780fa664662'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.462715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567ed4de4ecd444a8d86f2ef8328ac23', 'request_id': 'req-101f25ee-9fdd-4805-a8cb-c780fa664662'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.473490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] The token cache is being invalidate because project 567ed4de4ecd444a8d86f2ef8328ac23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:34:45.473776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.474401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-101f25ee-9fdd-4805-a8cb-c780fa664662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:34:45.475958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1214/2467] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:34:45 2022] DELETE /identity/v3/projects/567ed4de4ecd444a8d86f2ef8328ac23 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:34:45.482150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.482742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.483122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.501930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:45.503189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:45.563263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1254/2468] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:34:45.570799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.571091 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.571396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.590107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:45.591301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:45.599172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1215/2469] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:34:45.603639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.614660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b6b85-d436-4595-80e8-e70b97a7a570 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.619532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.620236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.620545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.620853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.621616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:34:45.621940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.623701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.635814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1255/2470] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:34:45.640179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.649576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deada3f8-38ea-401f-a5b7-67d83439e27c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.655048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.655741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.656025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.656300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.656998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.658910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.673761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:45.697250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1216/2471] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:34:45 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:45.701570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.711478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671a7a-67de-4827-b9ac-3071292c5486 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.769253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.769836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.770116 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.770391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.771073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.773174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.786449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:45.800934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1256/2472] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:34:45 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:34:45.805056 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.815705 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21f08-fab7-4c61-8b53-49e9d4a9b804 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.820352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.821013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.821295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.821569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.822293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.824030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.834179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1217/2473] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:34:45.838218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.849483 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838684c-dab3-4a55-9c41-0870d872133a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.854541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.855897 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.856363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.856698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.857468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.859150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef49d3-5a89-4ef0-8abe-83dac925d67a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.869734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1257/2474] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:34:45.873936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:45.883947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d046c-bf21-45f3-b462-8703e207a169 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:45.888580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:45.889451 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.889730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.890003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] PATH_INFO: `/v3/projects/3a26b6365ad840fda40f17fa52a1558e/users/f83f354cdfc54c49b9cb71a07dea4454/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.905945 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a26b6365ad840fda40f17fa52a1558e, user_id=f83f354cdfc54c49b9cb71a07dea4454, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:45.908647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:45.921902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1218/2475] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:34:45 2022] PUT /identity/v3/projects/3a26b6365ad840fda40f17fa52a1558e/users/f83f354cdfc54c49b9cb71a07dea4454/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:34:45.927073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1634-9a05-4340-93a2-d900398082c8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:45.927383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1634-9a05-4340-93a2-d900398082c8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:45.927668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b1634-9a05-4340-93a2-d900398082c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:45.945328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ea6b1634-9a05-4340-93a2-d900398082c8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:45.946542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ea6b1634-9a05-4340-93a2-d900398082c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:46.008506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1258/2476] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:34:46.019659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:46.021420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:46.081208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18869e76-0b79-4121-a4f8-80c9b8e815ff admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:46.084930 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:46.085576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:46.085859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:46.086136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:46.095707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:46.097135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:46.106598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1219/2477] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:49.822444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee51-8a2e-45a8-bb90-0a6b57e06bb5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:49.822945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee51-8a2e-45a8-bb90-0a6b57e06bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:49.823226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee51-8a2e-45a8-bb90-0a6b57e06bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:49.857214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3c66ee51-8a2e-45a8-bb90-0a6b57e06bb5 None None] MFA Rules not processed for user `f83f354cdfc54c49b9cb71a07dea4454`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:49.858691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3c66ee51-8a2e-45a8-bb90-0a6b57e06bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:49.930170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1259/2478] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:34:49.944804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:34:49.946447 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:50.025787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093211-5bd2-4bce-b9ad-5a45f3e57c0e service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:34:50.032261 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:34:50.032919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:50.033284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:50.033566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:50.042284 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:34:50.044560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943f9e2-c181-4d0a-9307-04e30a8ab23f service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:34:50.054282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1220/2479] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:34:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:34:51.368917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:34:51.369415 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:34:51.369710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:34:51.388112 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] MFA Rules not processed for user `f83f354cdfc54c49b9cb71a07dea4454`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:34:51.389425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:34:51.396438 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1260/2480] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:00.049789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:01.382255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:59.065742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1d41-bba4-4fdc-9083-3cdc4f5c93b3 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:59.066273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1d41-bba4-4fdc-9083-3cdc4f5c93b3 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:59.066374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1d41-bba4-4fdc-9083-3cdc4f5c93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:59.084992 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ba2a1d41-bba4-4fdc-9083-3cdc4f5c93b3 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:35:59.086197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ba2a1d41-bba4-4fdc-9083-3cdc4f5c93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:59.148304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1221/2481] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:35:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:35:59.196476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:35:59.197901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:35:59.271252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00516d-d225-4a68-897c-f5f8554ec5d3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:35:59.276288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:35:59.276944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:35:59.277230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:35:59.277505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:35:59.285538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:35:59.287125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:35:59.295925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1261/2482] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:36:09.137258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=25 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:09.292215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:20.479768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d94fc-2762-4f9b-8bb1-19e1f02070c6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.480330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d94fc-2762-4f9b-8bb1-19e1f02070c6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.480330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d94fc-2762-4f9b-8bb1-19e1f02070c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.499469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b17d94fc-2762-4f9b-8bb1-19e1f02070c6 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:20.500803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b17d94fc-2762-4f9b-8bb1-19e1f02070c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:20.508110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1222/2483] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:36:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:20.520925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:20.532472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9270d-28c2-4db3-944a-7899972d3c21 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:20.537812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:20.538475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:20.538756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:20.539027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:20.548587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:20.550262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd45d3-d2d4-4c16-ad0d-5c93a8ff4588 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:20.559314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1262/2484] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:36:22.725021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:22.725920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:22.726406 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:22.753525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] MFA Rules not processed for user `bf8e812b72a3456dbb303f0498b44334`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:22.755073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:22.827760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1223/2485] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:36:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:30.555628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:32.811456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=28 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:42.523915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.524413 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.524509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.543923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:36:42.545139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:36:42.554002 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1263/2486] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:36:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:36:42.566922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:36:42.579392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f5a5c-77e2-4169-9aac-8c8afd2ef24e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:36:42.584547 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:36:42.585267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:36:42.585645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:36:42.585932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:36:42.595214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:36:42.596858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:36:42.605576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1224/2487] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:36:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:36:52.538232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:36:52.601768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:37:13.931993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:37:13.933472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:14.001709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf883cd-a65c-4d6d-8871-99520caa4b91 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:37:14.006697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:37:14.007343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:37:14.007664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:37:14.007941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:37:14.009693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:37:14.020934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:37:14.022504 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:37:14.032807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1264/2488] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:37:24.028376 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:07.113867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:07.115255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:07.127604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e14999-6a9f-48e3-bacf-b8a1e352cce9 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:07.131123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:07.131795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:07.132077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:07.132350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:07.134039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:07.146135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:07.147660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:07.157454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1225/2489] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:10.145577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.157978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8718bf-38a5-409b-9bcf-3615d19092ab service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.164331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.165229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.165664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.166104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.168761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:10.181476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.183489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.197744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1265/2490] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:10.202068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.204716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:10.223347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f5804-1f34-4561-a21c-79fe37933be3 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.229541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.230439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.230722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.231176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] PATH_INFO: `/v3/users/4d86a6b64c22467d9852238e50122b17` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.233466 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d86a6b64c22467d9852238e50122b17)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.237463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.285385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d86a6b64c22467d9852238e50122b17'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.293388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d86a6b64c22467d9852238e50122b17'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.305423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d86a6b64c22467d9852238e50122b17'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.306105 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d86a6b64c22467d9852238e50122b17'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.312915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-7908e9d6-82fd-453b-80bd-6e8e421c6a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d86a6b64c22467d9852238e50122b17'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.318914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1226/2491] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:10 2022] DELETE /identity/v3/users/4d86a6b64c22467d9852238e50122b17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:10.493918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.505142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9388d4-9ca6-48e4-b7ed-afce6278df5d service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.562805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.563696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.563984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.564268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] PATH_INFO: `/v3/projects/055bf96c290640da8c0670440c132eee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.565460 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=055bf96c290640da8c0670440c132eee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.567405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.614482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055bf96c290640da8c0670440c132eee', 'request_id': 'req-22387416-410c-40c6-a709-04d6629285ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.620212 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055bf96c290640da8c0670440c132eee', 'request_id': 'req-22387416-410c-40c6-a709-04d6629285ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.627328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055bf96c290640da8c0670440c132eee', 'request_id': 'req-22387416-410c-40c6-a709-04d6629285ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.643169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] The token cache is being invalidate because project 055bf96c290640da8c0670440c132eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:10.643482 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.644132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-22387416-410c-40c6-a709-04d6629285ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:10.645682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1266/2492] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:10 2022] DELETE /identity/v3/projects/055bf96c290640da8c0670440c132eee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:10.650750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.651614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.651903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.669944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:10.671100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:10.732363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1227/2493] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:10.741048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.741343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.741626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.762270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:10.763714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:10.771753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1267/2494] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:10.776857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.786676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79087e76-2dc0-4d10-9071-339089c44d28 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.791679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.795096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.795460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.795814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.796977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:10.797286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.799860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.817889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1228/2495] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:10.822232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.833152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee8fe-ab72-40ca-9b08-a097ab3ea6bd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.837894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.838837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.839228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.839535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.840253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.842135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.871260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1268/2496] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:10 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:10.875314 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.886039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123488f3-499d-4782-84a3-45b3a97b1fbd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.929996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:10.945350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.946017 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.946376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.946653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.947333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.950246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:10.969516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1229/2497] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:10 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:10.973590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:10.984454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798dbe4-3559-47dc-a2d9-4f354313f549 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:10.988989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:10.989647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:10.989930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:10.990209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:10.990935 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:10.992559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:11.004849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1269/2498] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:11.008859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:11.019963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2337a9c-0f5c-48a7-b671-fded237022d6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:11.024707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:11.025364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:11.025706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:11.026151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:11.027031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:11.028699 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d9902-ce99-4e51-a742-488842b09dcd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:11.038768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1230/2499] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:11.043017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:11.052911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f3db-ade9-4d7e-9bae-ba4c530d5069 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:11.058143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:11.059016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:11.059304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:11.059617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] PATH_INFO: `/v3/projects/d22fbf3930f44e63a625363a486af82e/users/02a7b10d300a436587d2e18c40f3aa4d/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:11.074462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22fbf3930f44e63a625363a486af82e, user_id=02a7b10d300a436587d2e18c40f3aa4d, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:11.077160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:11.089962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1270/2500] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:11 2022] PUT /identity/v3/projects/d22fbf3930f44e63a625363a486af82e/users/02a7b10d300a436587d2e18c40f3aa4d/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:11.095159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e287c-b91c-4d3a-8103-4dd60fdac6f6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:11.095501 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e287c-b91c-4d3a-8103-4dd60fdac6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:11.095783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e287c-b91c-4d3a-8103-4dd60fdac6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:11.114165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-539e287c-b91c-4d3a-8103-4dd60fdac6f6 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:11.115410 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-539e287c-b91c-4d3a-8103-4dd60fdac6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:11.175756 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1231/2501] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:11.186289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:11.188004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:11.202564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:11.247565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97297401-bf62-431a-aa79-31c8b9eab87c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:11.251216 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:11.251899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:11.252184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:11.252461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:11.261644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:11.263072 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:11.272455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1271/2502] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:11.892236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:11.892792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:11.892792 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:11.923950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] MFA Rules not processed for user `02a7b10d300a436587d2e18c40f3aa4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:11.926543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:11.998179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1232/2503] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:12.002449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.013590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc4252-4c77-44fc-84ba-14fdab5f45a1 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.018430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.019171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.019566 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.019918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.020695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.023234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.053321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1272/2504] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:12 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:12.057207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.068743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41339c7-d97f-4fd7-a811-6ca259b6c58b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.131125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:12.149814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.150652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.151499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.151771 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.152502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.154438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.176046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1233/2505] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:12 2022] POST /identity/v3/users => generated 308 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:12.179960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.190617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cf9e-6969-4155-b171-9b1f28c8ad9c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.195399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.196050 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.196333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.196609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.197365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.199505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.210598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1273/2506] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:12.215733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.226023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ad0bd-b0db-47f3-a97d-57aa747064f6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.231449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.232333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.232618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.232896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] PATH_INFO: `/v3/projects/2d8c5fa32dcd42d5a29deabe70459022/users/0caf6f974ed2409ab55b9df42b1840be/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.247598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8c5fa32dcd42d5a29deabe70459022, user_id=0caf6f974ed2409ab55b9df42b1840be, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.250280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.263943 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1234/2507] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:12 2022] PUT /identity/v3/projects/2d8c5fa32dcd42d5a29deabe70459022/users/0caf6f974ed2409ab55b9df42b1840be/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:12.268080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.278811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea137f-69b5-4aa0-a5c2-cb54c7928e19 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.334767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.335456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.335744 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.336023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.336740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.338377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544fc73-62e5-4eea-b733-f439b7a32041 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.348101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1274/2508] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:12.352276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:12.362782 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706e1f9-b4cf-4336-933d-66f8beb46edc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:12.367404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:12.368282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:12.368568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:12.368846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] PATH_INFO: `/v3/projects/2d8c5fa32dcd42d5a29deabe70459022/users/0caf6f974ed2409ab55b9df42b1840be/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:12.371336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8c5fa32dcd42d5a29deabe70459022, user_id=0caf6f974ed2409ab55b9df42b1840be, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:12.374032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:12.384196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1235/2509] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:12 2022] PUT /identity/v3/projects/2d8c5fa32dcd42d5a29deabe70459022/users/0caf6f974ed2409ab55b9df42b1840be/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:13.007749 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:13.008272 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:13.008719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:13.038173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] MFA Rules not processed for user `0caf6f974ed2409ab55b9df42b1840be`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:13.039540 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:13.115497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1275/2510] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:38:14.107909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:14.109793 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:14.174372 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:14.180730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:14.192472 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ced2b-5b79-4a7e-b4b9-1e363b69aa58 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:14.197928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:14.198400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:14.198687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:14.198963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:14.200808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:14.212543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:14.214338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:14.225025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1236/2511] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:14.245740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5d375-01f5-4766-b27a-ab4e3fa8150e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:14.250473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:14.251461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:14.251748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:14.252024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] PATH_INFO: `/v3/users/02a7b10d300a436587d2e18c40f3aa4d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:14.253224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a7b10d300a436587d2e18c40f3aa4d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:14.255137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:14.303511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a7b10d300a436587d2e18c40f3aa4d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.320155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a7b10d300a436587d2e18c40f3aa4d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.328477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a7b10d300a436587d2e18c40f3aa4d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.329141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a7b10d300a436587d2e18c40f3aa4d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.336529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a7b10d300a436587d2e18c40f3aa4d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.342984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1276/2512] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:14 2022] DELETE /identity/v3/users/02a7b10d300a436587d2e18c40f3aa4d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:14.523308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:14.535018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d9e31-93fe-436f-a092-5883e42ffc97 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:14.593487 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:14.594273 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:14.594563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:14.594841 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] PATH_INFO: `/v3/projects/d22fbf3930f44e63a625363a486af82e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:14.596064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22fbf3930f44e63a625363a486af82e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:14.597991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:14.637213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:14.645571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22fbf3930f44e63a625363a486af82e', 'request_id': 'req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.653239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22fbf3930f44e63a625363a486af82e', 'request_id': 'req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.659259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22fbf3930f44e63a625363a486af82e', 'request_id': 'req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.671440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] The token cache is being invalidate because project d22fbf3930f44e63a625363a486af82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:14.671736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.672395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.674090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1237/2513] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:14 2022] DELETE /identity/v3/projects/d22fbf3930f44e63a625363a486af82e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:14.678137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:14.679577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:14.693171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d36863-f488-4f21-95fc-ab945a966dfb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:14.756183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:14.757074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:14.757355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:14.757630 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] PATH_INFO: `/v3/users/0caf6f974ed2409ab55b9df42b1840be` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:14.758820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0caf6f974ed2409ab55b9df42b1840be)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:14.761281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:14.796580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:14.826687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0caf6f974ed2409ab55b9df42b1840be'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.840149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0caf6f974ed2409ab55b9df42b1840be'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.848215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0caf6f974ed2409ab55b9df42b1840be'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.848940 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0caf6f974ed2409ab55b9df42b1840be'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.857571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c485d0e4-8166-403e-bb5a-faded166891a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0caf6f974ed2409ab55b9df42b1840be'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:14.871192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1277/2514] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:14 2022] DELETE /identity/v3/users/0caf6f974ed2409ab55b9df42b1840be => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:15.039059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.040550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:15.053553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835fa4d-ef5a-4f50-8c57-c328ed5cf53e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.111219 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.112033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.112320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.112640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] PATH_INFO: `/v3/projects/2d8c5fa32dcd42d5a29deabe70459022` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.114023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8c5fa32dcd42d5a29deabe70459022)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.115980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.164453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8c5fa32dcd42d5a29deabe70459022', 'request_id': 'req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:15.172453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8c5fa32dcd42d5a29deabe70459022', 'request_id': 'req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:15.178171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8c5fa32dcd42d5a29deabe70459022', 'request_id': 'req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:15.189505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] The token cache is being invalidate because project 2d8c5fa32dcd42d5a29deabe70459022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:15.189789 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:15.190408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f76a3ba3-24c8-4a06-9247-6c1fe31d49ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:15.192005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1238/2515] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:15 2022] DELETE /identity/v3/projects/2d8c5fa32dcd42d5a29deabe70459022 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:15.196842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.197853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.198093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.216811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:15.218034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:15.278602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1278/2516] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:15.286399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.286688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.286962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.305439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:15.307214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:15.315378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1239/2517] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:15.319557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.329581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357d62-2b18-4e0b-bc4d-6ac51a62f814 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.334226 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.334875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.335159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.335467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.336187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:15.336491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.338561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.350068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1279/2518] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:15.354374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.364096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3afa1d-91a3-42cd-b9ca-dd162749e759 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.368712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.370050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.370405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.370682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.371456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.373341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.398428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1240/2519] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:15.402648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.413208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4f9d-ff37-4d02-a8c8-d27528c2d575 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.469513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.470183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.470467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.470773 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.471525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.473459 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.492635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1280/2520] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:15.497383 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.507674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae812250-ed85-4c4a-bd0d-5ff1b1ec58c6 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.512436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.513604 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.513917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.514247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.515199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.516850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.527417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1241/2521] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:15.531277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.541414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6119ac0-8c90-47cb-981f-af2c35af0f90 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.546044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.546698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.546984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.547264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.548024 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.549604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15fc99-d85b-44c8-89ad-74a599f24aea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.560064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1281/2522] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:15.564058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.574609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db92c17-bc68-4016-91e6-b1ca897399be admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.579386 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.580271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.580549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.580824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] PATH_INFO: `/v3/projects/b904818b15a14c878aea517c73401146/users/e001b3b25d5448ebbc352eee5a8aac46/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.595520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b904818b15a14c878aea517c73401146, user_id=e001b3b25d5448ebbc352eee5a8aac46, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.598172 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.600331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:15.612150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1242/2523] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:15 2022] PUT /identity/v3/projects/b904818b15a14c878aea517c73401146/users/e001b3b25d5448ebbc352eee5a8aac46/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:15.624172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.624403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.624686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.643187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:15.653611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] MFA Rules not processed for user `e001b3b25d5448ebbc352eee5a8aac46`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:15.655228 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:15.718562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1282/2524] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:15.723047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.787340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbfe17-2155-40ae-b6b0-d64d57106149 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.792769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.793645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.793761 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.793981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.794677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.796963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.823745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1243/2525] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:15.827873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.838774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6215f-d89b-4809-ae23-924bb684ca09 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.898385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.899069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.899373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.899668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.901196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.903490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.925602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1283/2526] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:15 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:15.929414 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.940856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b69b5-9cd0-44f4-8af6-bcd0ed79dd90 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.945517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.946184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.946462 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.946736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.947701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:15.949454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:15.960271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1244/2527] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:15.964495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:15.975850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0fd26-a6ec-4d37-9364-3c4f0ddf3b2b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:15.981411 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:15.982351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:15.982638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:15.982917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] PATH_INFO: `/v3/projects/2aae5dbd4c29499b95d65d352a855ae9/users/0eefbb538ae54479adf392f5cb620453/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:15.998724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aae5dbd4c29499b95d65d352a855ae9, user_id=0eefbb538ae54479adf392f5cb620453, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:16.001437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:16.016249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1284/2528] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:15 2022] PUT /identity/v3/projects/2aae5dbd4c29499b95d65d352a855ae9/users/0eefbb538ae54479adf392f5cb620453/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:16.020186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:16.031201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abff30f-992a-4f27-921b-4c30b4d4d3bc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:16.087510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:16.088827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:16.089121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:16.089403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:16.090126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:16.091768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44894ce-451c-4734-900a-d634ee9da0d5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:16.101468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1245/2529] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:16.106317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:16.116593 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347466f-f8d0-4097-ac72-dfa90e3ef3e7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:16.121610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:16.122496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:16.122778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:16.123055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] PATH_INFO: `/v3/projects/2aae5dbd4c29499b95d65d352a855ae9/users/0eefbb538ae54479adf392f5cb620453/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:16.125102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aae5dbd4c29499b95d65d352a855ae9, user_id=0eefbb538ae54479adf392f5cb620453, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:16.127867 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:16.137999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1285/2530] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:16 2022] PUT /identity/v3/projects/2aae5dbd4c29499b95d65d352a855ae9/users/0eefbb538ae54479adf392f5cb620453/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:16.148037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:16.148516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:16.148635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:16.176126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] MFA Rules not processed for user `0eefbb538ae54479adf392f5cb620453`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:16.177337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:16.227157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:16.247005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1246/2531] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:16.257893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:16.259716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:16.317068 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f93f90-7ebf-43f1-b47a-14011aa9401b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:16.320745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:16.321386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:16.321669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:16.321949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:16.327953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:16.332451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:16.334227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6b7e4-eb9a-457c-a837-ad02e24c6c5e service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:16.344588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1286/2532] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:17.672081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:17.742940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd5bcd-60fd-4e50-aca8-ad945590b05e None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:17.749938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:17.750818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.751097 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.751387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] PATH_INFO: `/v3/users/e001b3b25d5448ebbc352eee5a8aac46` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:17.752694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e001b3b25d5448ebbc352eee5a8aac46)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:17.754690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:17.801244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e001b3b25d5448ebbc352eee5a8aac46'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:17.808768 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e001b3b25d5448ebbc352eee5a8aac46'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:17.820889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e001b3b25d5448ebbc352eee5a8aac46'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:17.821599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e001b3b25d5448ebbc352eee5a8aac46'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:17.829184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e001b3b25d5448ebbc352eee5a8aac46'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:17.835672 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1247/2533] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:17 2022] DELETE /identity/v3/users/e001b3b25d5448ebbc352eee5a8aac46 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:17.840405 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.840853 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.840951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:17.858167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:17.859351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:17.918017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1287/2534] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:17.927804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:17.929253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:17.986473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c5de-e561-4a6e-8b9d-9bad58270691 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:17.990150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:17.990796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:17.991079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:17.991353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:18.001391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:18.002828 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:18.012319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1248/2535] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:18.279917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:18.281533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:18.296608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc62aae-cc75-46d2-87c8-c1574836c743 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:18.301695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:18.302923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:18.303724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:18.303724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] PATH_INFO: `/v3/projects/b904818b15a14c878aea517c73401146` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:18.304842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b904818b15a14c878aea517c73401146)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:18.306888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:18.359255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b904818b15a14c878aea517c73401146', 'request_id': 'req-d0114843-5d28-4933-8732-9ea0fbe9073c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.365666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b904818b15a14c878aea517c73401146', 'request_id': 'req-d0114843-5d28-4933-8732-9ea0fbe9073c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.373758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b904818b15a14c878aea517c73401146', 'request_id': 'req-d0114843-5d28-4933-8732-9ea0fbe9073c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.384893 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] The token cache is being invalidate because project b904818b15a14c878aea517c73401146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:18.385182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.385902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.387572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1288/2536] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:18 2022] DELETE /identity/v3/projects/b904818b15a14c878aea517c73401146 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:18.391647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:18.402621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20d12d-4a42-4d36-9634-c7db9a59823d service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:18.411134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:18.467556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:18.468438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:18.468726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:18.469720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] PATH_INFO: `/v3/users/0eefbb538ae54479adf392f5cb620453` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:18.471311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eefbb538ae54479adf392f5cb620453)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:18.473277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:18.523387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eefbb538ae54479adf392f5cb620453'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.531201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eefbb538ae54479adf392f5cb620453'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.544497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eefbb538ae54479adf392f5cb620453'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.545238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eefbb538ae54479adf392f5cb620453'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.553061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-0ecf1aa6-b022-4c49-8066-4a89727884dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eefbb538ae54479adf392f5cb620453'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:18.559391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1249/2537] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:18 2022] DELETE /identity/v3/users/0eefbb538ae54479adf392f5cb620453 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:18.992567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:18.994358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:19.022291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0114843-5d28-4933-8732-9ea0fbe9073c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.104555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.105491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.105829 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.106106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] PATH_INFO: `/v3/projects/2aae5dbd4c29499b95d65d352a855ae9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.107551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aae5dbd4c29499b95d65d352a855ae9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.109496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.148049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:19.192360 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aae5dbd4c29499b95d65d352a855ae9', 'request_id': 'req-a41ca45e-b579-4568-9dd1-006ee90d8da8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:19.198972 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aae5dbd4c29499b95d65d352a855ae9', 'request_id': 'req-a41ca45e-b579-4568-9dd1-006ee90d8da8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:19.206998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aae5dbd4c29499b95d65d352a855ae9', 'request_id': 'req-a41ca45e-b579-4568-9dd1-006ee90d8da8'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:19.221457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] The token cache is being invalidate because project 2aae5dbd4c29499b95d65d352a855ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:19.221751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:19.222496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a41ca45e-b579-4568-9dd1-006ee90d8da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:19.224238 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1289/2538] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:18 2022] DELETE /identity/v3/projects/2aae5dbd4c29499b95d65d352a855ae9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:19.229743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.230344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.230344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.248936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:19.250147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:19.312861 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1250/2539] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:19.321384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.321674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.322084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.340979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:19.342177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:19.350358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1290/2540] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:19.354536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.364388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be4ab-7645-43ce-9231-249a37c4294f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.369571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.370223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.370509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.370783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.371605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:19.371917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.373654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.386915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1251/2541] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:19.391165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.400696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b04e8d-c4fe-47ea-8287-c75e7cf8073f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.405426 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.406083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.406367 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.406644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.407329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.409299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.440148 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1291/2542] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:19.441339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.451492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7ea36-b9a3-409a-a9bb-86d307f7877d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.464525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:19.519754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.520562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.520851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.521260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.522078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.524102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.546796 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1252/2543] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:19.550901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.562066 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e646a-642b-46f1-a8b7-31733a19912b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.566684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.567348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.567665 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.567946 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.568698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.570288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.581201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1292/2544] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:19.585084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.597750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb1b57-445b-4c4f-b8c9-56ba9457d577 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.600404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.601204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.601489 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.601765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.602490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.604795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b0b6b-9d47-4d6d-88d9-ebddee862a8a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.614767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1253/2545] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:19.618784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.629182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9e855-eb34-4663-8c2d-418cddb457de admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.634151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.635131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.635450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.635734 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] PATH_INFO: `/v3/projects/91a8fa0be9a642938356de210e27f17e/users/02781d437e5647b3be8b619aed9f4133/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.650169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a8fa0be9a642938356de210e27f17e, user_id=02781d437e5647b3be8b619aed9f4133, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.652850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.667273 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1293/2546] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:19 2022] PUT /identity/v3/projects/91a8fa0be9a642938356de210e27f17e/users/02781d437e5647b3be8b619aed9f4133/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:19.677712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.678003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.678280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.704893 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] MFA Rules not processed for user `02781d437e5647b3be8b619aed9f4133`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:19.706337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:19.770598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1254/2547] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:19.774938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.841028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fdb4e-9068-4fcd-a33b-545ca0511417 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.845793 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.846446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.846730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.847007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.847770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.849672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.875981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1294/2548] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:19.880096 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.890716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4936e-5351-45d3-8607-e3e40835a423 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.947385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.948077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.948365 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.948642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.949330 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.951268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:19.970860 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1255/2549] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:19 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:19.975045 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:19.986527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411771a-bfe7-4719-9acf-9e8c58b9d798 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:19.991244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:19.992028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:19.992382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:19.992795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:19.993512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:19.995635 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.007089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1295/2550] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:20.011343 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.024304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d662c-ceea-4142-98a6-9205aac237ac admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.030415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.031690 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.031976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.032254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] PATH_INFO: `/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf/users/a95e1216a9694413aa8f32036cf02b48/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.046081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:20.049392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7f82fdedcb417ea407c6a8b1f1ffbf, user_id=a95e1216a9694413aa8f32036cf02b48, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.052742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.065534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1256/2551] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:20 2022] PUT /identity/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf/users/a95e1216a9694413aa8f32036cf02b48/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:20.069490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.079532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2548c6-f8fc-4886-9a85-1f1f30454445 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.092846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:20.138570 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.139304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.139619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.139901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.140645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.142243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef62da5-3c6a-4320-826a-d94d6430849e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.152756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1296/2552] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:20.157038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.167618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07060c1e-a346-4d79-9075-49b5b9023a2a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.172200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.173075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.173358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.173634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] PATH_INFO: `/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf/users/a95e1216a9694413aa8f32036cf02b48/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.175620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7f82fdedcb417ea407c6a8b1f1ffbf, user_id=a95e1216a9694413aa8f32036cf02b48, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.178272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.189357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1257/2553] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:20 2022] PUT /identity/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf/users/a95e1216a9694413aa8f32036cf02b48/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:20.199715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.200010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.200295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.227293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] MFA Rules not processed for user `a95e1216a9694413aa8f32036cf02b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:20.228670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:20.306079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1297/2554] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:38:20.318062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.319911 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:20.379850 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b1c3d-d977-4143-81ae-aaa561b19ce3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.383748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.384934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.385334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.385809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.397394 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.398833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.409223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1258/2555] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:20.733351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.742989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee2624-c393-4a92-8351-e247036488d5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.750332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95e1216a9694413aa8f32036cf02b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.751071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.751407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.751719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.752528 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:20.752846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.754558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.768390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1298/2556] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:20.772291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.782130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8c07-59a8-4db8-a239-d456f07c6f1f service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.787063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95e1216a9694413aa8f32036cf02b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.787751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.788036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.788311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.788995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.790950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.818592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1259/2557] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:20 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:20.823810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.833962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20bf46-c5de-42f9-b406-a4016882aa90 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.890184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95e1216a9694413aa8f32036cf02b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.890769 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.891055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.891331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.892080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:20.892384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.893998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:20.905663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1299/2558] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:20.944875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:20.955573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce2f89-7ad6-4ddf-810b-a89c5e4aeba4 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:20.960294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95e1216a9694413aa8f32036cf02b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:20.961153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:20.961441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:20.961719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] PATH_INFO: `/v3/projects/f3a6e70fa5214a39877c749c7b73c45e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:20.962997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3a6e70fa5214a39877c749c7b73c45e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:20.965416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:21.012490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a6e70fa5214a39877c749c7b73c45e', 'request_id': 'req-f66e7575-4f70-4e49-babe-490b25815435'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.019824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a6e70fa5214a39877c749c7b73c45e', 'request_id': 'req-f66e7575-4f70-4e49-babe-490b25815435'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.025552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a6e70fa5214a39877c749c7b73c45e', 'request_id': 'req-f66e7575-4f70-4e49-babe-490b25815435'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.036377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] The token cache is being invalidate because project f3a6e70fa5214a39877c749c7b73c45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:21.036683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.037572 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f66e7575-4f70-4e49-babe-490b25815435 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.039400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1260/2559] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:20 2022] DELETE /identity/v3/projects/f3a6e70fa5214a39877c749c7b73c45e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:21.233434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:21.235227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:21.264628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:21.315992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06491bb3-2dd1-422d-b920-68c353c88076 tempest-VolumeQuotaClassesTest-1903351183 tempest-VolumeQuotaClassesTest-1903351183-project-admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:21.377572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:21.378458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:21.378802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:21.379079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] PATH_INFO: `/v3/users/02781d437e5647b3be8b619aed9f4133` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:21.380326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02781d437e5647b3be8b619aed9f4133)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:21.382427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:21.433034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02781d437e5647b3be8b619aed9f4133'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.445701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02781d437e5647b3be8b619aed9f4133'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.453478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02781d437e5647b3be8b619aed9f4133'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.454209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02781d437e5647b3be8b619aed9f4133'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.461983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02781d437e5647b3be8b619aed9f4133'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:21.469061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1300/2560] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:21 2022] DELETE /identity/v3/users/02781d437e5647b3be8b619aed9f4133 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:21.473733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:21.474247 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:21.474399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:21.494714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:21.496156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:21.548475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:21.579562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1261/2561] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:21.591486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:21.592956 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:21.654974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:21.676199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0aa2-8162-456e-aa12-0ad2ddc18ae6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:21.681802 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:21.682804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:21.683089 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:21.683539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:21.701690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:21.706918 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:21.723590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1301/2562] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:22.055714 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:22.058025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:22.071701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a57f9-6fd8-4b66-8987-a00a9b54429f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:22.077331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:22.078209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.078634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.079109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] PATH_INFO: `/v3/projects/91a8fa0be9a642938356de210e27f17e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.080958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a8fa0be9a642938356de210e27f17e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:22.083490 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:22.136912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a8fa0be9a642938356de210e27f17e', 'request_id': 'req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.144348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a8fa0be9a642938356de210e27f17e', 'request_id': 'req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.150213 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a8fa0be9a642938356de210e27f17e', 'request_id': 'req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.162647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] The token cache is being invalidate because project 91a8fa0be9a642938356de210e27f17e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:22.162931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.163661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.165153 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1262/2563] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:22 2022] DELETE /identity/v3/projects/91a8fa0be9a642938356de210e27f17e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:22.169256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:22.179410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80e073-289f-4762-8de6-d8e801e83f6a service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:22.243261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:22.245014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.245310 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.245589 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] PATH_INFO: `/v3/users/a95e1216a9694413aa8f32036cf02b48` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.247911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95e1216a9694413aa8f32036cf02b48)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:22.248742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:22.306782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95e1216a9694413aa8f32036cf02b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.318521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95e1216a9694413aa8f32036cf02b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.325934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95e1216a9694413aa8f32036cf02b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.326608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95e1216a9694413aa8f32036cf02b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.334101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-115bbd98-6225-4d73-931b-e659177047a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95e1216a9694413aa8f32036cf02b48'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.340543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1302/2564] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:22 2022] DELETE /identity/v3/users/a95e1216a9694413aa8f32036cf02b48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:22.616636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:22.618230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:22.634944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af49ee-f903-4b27-9171-8f1b1a0b2ef2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:22.707713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:22.709027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.709324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.709603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] PATH_INFO: `/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.710804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7f82fdedcb417ea407c6a8b1f1ffbf)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:22.713068 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:22.765493 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'request_id': 'req-81eed865-4743-4fd1-b13e-a92bf2b50510'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.772977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'request_id': 'req-81eed865-4743-4fd1-b13e-a92bf2b50510'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.779140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7f82fdedcb417ea407c6a8b1f1ffbf', 'request_id': 'req-81eed865-4743-4fd1-b13e-a92bf2b50510'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.781129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:22.798959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] The token cache is being invalidate because project 5c7f82fdedcb417ea407c6a8b1f1ffbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:22.798959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.799637 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81eed865-4743-4fd1-b13e-a92bf2b50510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:22.801518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1263/2565] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:22 2022] DELETE /identity/v3/projects/5c7f82fdedcb417ea407c6a8b1f1ffbf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:22.806261 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.806647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.806936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.827085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:22.828820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:22.891246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1303/2566] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:22.898914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.899212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.899534 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.919590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:22.921010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:22.929110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1264/2567] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:22.933739 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:22.943943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddf7c-c735-438a-9982-8e834fa5b1ce None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:22.949516 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:22.950222 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.950506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.951163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.951558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:22.951850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:22.953672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:22.956524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:22.968470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1304/2568] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:38:22.973032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:22.984218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b4ee-b1d9-406f-94bb-96ea672e7d05 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:22.989231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:22.989914 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:22.990199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:22.990958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:22.991198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:22.993216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.025691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1265/2569] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:22 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:23.029615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.043602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d777e3-7ceb-4c36-a53d-fcb91c4a9b23 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.101729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.102403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.102685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.103692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.104711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.106626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.127091 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1305/2570] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:23.131477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.142535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452000-3da8-411c-8ca4-b44e41202a5e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.147180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.147965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.148313 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.148652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.149442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.151892 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.163216 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1266/2571] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:23.167725 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.178466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3e4a9-fb98-4fa0-b22e-d3240df351ee admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.184916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.185280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.185629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.185978 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.186716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.188349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636ed17-0786-41fe-8413-82329db42ca9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.199408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1306/2572] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:23.203557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.217935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9283e9-0e57-48c1-97db-078b44b64aed admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.222651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.223561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.223840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.224114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] PATH_INFO: `/v3/projects/67bb44a6f38e4951ab7994d7bb07d01a/users/ac308715bfdf40e695887b8e0d2eb168/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.239286 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bb44a6f38e4951ab7994d7bb07d01a, user_id=ac308715bfdf40e695887b8e0d2eb168, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.241966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.255155 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1267/2573] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:23 2022] PUT /identity/v3/projects/67bb44a6f38e4951ab7994d7bb07d01a/users/ac308715bfdf40e695887b8e0d2eb168/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:23.265705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.266174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.266322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.293484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] MFA Rules not processed for user `ac308715bfdf40e695887b8e0d2eb168`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:23.294684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:23.366601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1307/2574] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:23.371695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.435300 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c5de8-2351-47d7-9ba3-c39269e6d7f4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.440331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.441004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.441288 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.441569 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.442262 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.444239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.471474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1268/2575] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:23.474128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.486015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57cd2e-9485-4cd7-af68-6248ce75af5a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.546279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.547075 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.547396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.547670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.548484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.550532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.559452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:23.571582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1308/2576] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:23.575598 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.586078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582b08a-be4a-4dae-b97d-5e40878cf20a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.591460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.592120 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.592407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.592686 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.593412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.595018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.606065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1269/2577] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:23.610014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.620093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027e8e-0f8c-4d86-926f-6014458b5e41 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.624691 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.625362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.625712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.625992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.626718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.628329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ebc93-c178-4c06-8e94-63728cdc9166 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.638514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1309/2578] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:23.642433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.653227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f155ed-3bbe-4684-aad7-f69124fdb731 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.657846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.658720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.659005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.659283 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] PATH_INFO: `/v3/projects/b708f21012514bda90547f906d10775d/users/9694630c0f2f43af8177bdf89daec1a3/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.674754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b708f21012514bda90547f906d10775d, user_id=9694630c0f2f43af8177bdf89daec1a3, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.677474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.691004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1270/2579] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:23 2022] PUT /identity/v3/projects/b708f21012514bda90547f906d10775d/users/9694630c0f2f43af8177bdf89daec1a3/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:23.701967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.702264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.702552 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.731293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] MFA Rules not processed for user `9694630c0f2f43af8177bdf89daec1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:23.732507 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:23.798705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1310/2580] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:23.803150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.848960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:23.867204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b5189-2f7c-44d8-8e5b-4cfa35caee12 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.872016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.872678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.872966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.873246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.873947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.875922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.901642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1271/2581] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:23.905670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:23.916839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096e4c-d17d-4cc1-a618-56e44cf5b48d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:23.973758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:23.974425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:23.974712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:23.974992 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:23.975722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:23.977654 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:23.997088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1311/2582] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:23 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:24.001042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.012133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fd22-37e8-4802-8b8c-65f53270bb81 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.016785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.017439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.017718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.017989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.018704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.020329 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.031821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1272/2583] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:24.035996 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.046489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4841-807a-468c-9c41-a9e1e7a95e78 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.051195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.052147 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.052435 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.052717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] PATH_INFO: `/v3/projects/5c210f2422d4445a882d1185388029b5/users/b6f8b51b06104f8280de9f2cf9cab794/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.067587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c210f2422d4445a882d1185388029b5, user_id=b6f8b51b06104f8280de9f2cf9cab794, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.070243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.083356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1312/2584] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:24 2022] PUT /identity/v3/projects/5c210f2422d4445a882d1185388029b5/users/b6f8b51b06104f8280de9f2cf9cab794/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:24.087940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.097986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4228c5-da46-4c8b-a61a-c6cf9555bbfa admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.155268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.155968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.156270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.156520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.157233 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.158826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fe887-dcc2-44e7-9b47-3e9c95eecbb8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.169531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1273/2585] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:24.173789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.184726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325b025-8e05-441c-baf4-ff89abc06328 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.189354 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.190236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.190538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.190812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] PATH_INFO: `/v3/projects/5c210f2422d4445a882d1185388029b5/users/b6f8b51b06104f8280de9f2cf9cab794/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.192814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c210f2422d4445a882d1185388029b5, user_id=b6f8b51b06104f8280de9f2cf9cab794, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.195724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.206388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1313/2586] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:24 2022] PUT /identity/v3/projects/5c210f2422d4445a882d1185388029b5/users/b6f8b51b06104f8280de9f2cf9cab794/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:24.217152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.217446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.217729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.246880 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] MFA Rules not processed for user `b6f8b51b06104f8280de9f2cf9cab794`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:24.248220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:24.326652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1274/2587] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:24.340083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.341877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:24.376055 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:24.409639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28c11-67c5-4d2f-90e0-bbc30f4abebc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.413551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.414206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.414494 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.414772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.425902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.427653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.437961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1314/2588] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:24.480180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:24.481566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:24.493559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dbc39-5abd-41a8-b02d-c64f47b7973d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:24.497541 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:24.498180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:24.498516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:24.498736 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:24.533739 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:24.557712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:24.559132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6cd3-a469-4c4e-9002-9f9c451f3d01 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:24.568030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1275/2589] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:27.483268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:27.544610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cccf-96b4-4576-89f1-8bcd9550de5f service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:27.549115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:27.549977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:27.550256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:27.550531 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] PATH_INFO: `/v3/users/ac308715bfdf40e695887b8e0d2eb168` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:27.551733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac308715bfdf40e695887b8e0d2eb168)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:27.553629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:27.598211 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac308715bfdf40e695887b8e0d2eb168'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:27.611388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac308715bfdf40e695887b8e0d2eb168'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:27.618301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac308715bfdf40e695887b8e0d2eb168'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:27.619143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac308715bfdf40e695887b8e0d2eb168'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:27.626015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac308715bfdf40e695887b8e0d2eb168'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:27.632097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1315/2590] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:27 2022] DELETE /identity/v3/users/ac308715bfdf40e695887b8e0d2eb168 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:27.637189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:27.637712 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:27.637808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:27.654988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:27.656225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:27.716605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1276/2591] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:27.726161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:27.727669 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:27.779796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:27.784896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe7491-6a9b-4783-b98c-305675d7f662 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:27.789877 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:27.790832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:27.791302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:27.791631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:27.801266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:27.802724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:27.812444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1316/2592] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:28.194567 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:28.197005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:28.221412 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a09cb-27a1-4e74-b1e4-00c1df58e853 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:28.228634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:28.229516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:28.230186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:28.230186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] PATH_INFO: `/v3/projects/67bb44a6f38e4951ab7994d7bb07d01a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:28.231278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bb44a6f38e4951ab7994d7bb07d01a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:28.233608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:28.287325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bb44a6f38e4951ab7994d7bb07d01a', 'request_id': 'req-6bad8538-0e31-4568-a10d-8272317d6f06'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.297755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bb44a6f38e4951ab7994d7bb07d01a', 'request_id': 'req-6bad8538-0e31-4568-a10d-8272317d6f06'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.304239 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bb44a6f38e4951ab7994d7bb07d01a', 'request_id': 'req-6bad8538-0e31-4568-a10d-8272317d6f06'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.317125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] The token cache is being invalidate because project 67bb44a6f38e4951ab7994d7bb07d01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:28.317708 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.318373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.319968 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1277/2593] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:28 2022] DELETE /identity/v3/projects/67bb44a6f38e4951ab7994d7bb07d01a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:28.323975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:28.334577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1567156-e631-41fd-8eb5-c0de3e2b7bcf service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:28.396574 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:28.397468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:28.397758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:28.398033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] PATH_INFO: `/v3/users/9694630c0f2f43af8177bdf89daec1a3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:28.399248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9694630c0f2f43af8177bdf89daec1a3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:28.402307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:28.453414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9694630c0f2f43af8177bdf89daec1a3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.467631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9694630c0f2f43af8177bdf89daec1a3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.474683 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9694630c0f2f43af8177bdf89daec1a3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.475431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9694630c0f2f43af8177bdf89daec1a3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.482974 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9694630c0f2f43af8177bdf89daec1a3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.489326 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1317/2594] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:28 2022] DELETE /identity/v3/users/9694630c0f2f43af8177bdf89daec1a3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:28.774264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:28.776602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:28.789622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad8538-0e31-4568-a10d-8272317d6f06 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:28.858657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:28.859554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:28.859838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:28.860109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] PATH_INFO: `/v3/projects/b708f21012514bda90547f906d10775d` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:28.861272 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b708f21012514bda90547f906d10775d)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:28.863174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:28.864642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:28.910759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b708f21012514bda90547f906d10775d', 'request_id': 'req-a17a0b11-fc78-4b33-b3f1-666203476e78'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.918159 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b708f21012514bda90547f906d10775d', 'request_id': 'req-a17a0b11-fc78-4b33-b3f1-666203476e78'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.923784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b708f21012514bda90547f906d10775d', 'request_id': 'req-a17a0b11-fc78-4b33-b3f1-666203476e78'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.935438 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] The token cache is being invalidate because project b708f21012514bda90547f906d10775d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:28.935730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.936372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:28.937927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1278/2595] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:28 2022] DELETE /identity/v3/projects/b708f21012514bda90547f906d10775d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:28.942012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:28.943466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:28.957403 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8191925-4262-44ad-a071-490053fea21d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.013883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.014758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.015040 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.015316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] PATH_INFO: `/v3/users/b6f8b51b06104f8280de9f2cf9cab794` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.016523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f8b51b06104f8280de9f2cf9cab794)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.018452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.028476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:29.065475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f8b51b06104f8280de9f2cf9cab794'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.080069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f8b51b06104f8280de9f2cf9cab794'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.086820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f8b51b06104f8280de9f2cf9cab794'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.087775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f8b51b06104f8280de9f2cf9cab794'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.094730 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e36d105d-87d9-409b-b80b-297562942692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f8b51b06104f8280de9f2cf9cab794'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.100716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1318/2596] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:28 2022] DELETE /identity/v3/users/b6f8b51b06104f8280de9f2cf9cab794 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:29.382312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.383826 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:29.397291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a0b11-fc78-4b33-b3f1-666203476e78 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.457634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.458440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.458740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.459000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] PATH_INFO: `/v3/projects/5c210f2422d4445a882d1185388029b5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.460212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c210f2422d4445a882d1185388029b5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.462189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.508280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c210f2422d4445a882d1185388029b5', 'request_id': 'req-d259da33-ddcb-4d19-9587-868470aad3a6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.515346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c210f2422d4445a882d1185388029b5', 'request_id': 'req-d259da33-ddcb-4d19-9587-868470aad3a6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.520986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c210f2422d4445a882d1185388029b5', 'request_id': 'req-d259da33-ddcb-4d19-9587-868470aad3a6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.532599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] The token cache is being invalidate because project 5c210f2422d4445a882d1185388029b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:29.532889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.533525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d259da33-ddcb-4d19-9587-868470aad3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:29.535257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1279/2597] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:29 2022] DELETE /identity/v3/projects/5c210f2422d4445a882d1185388029b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:29.541842 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.542304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.542398 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.561682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:29.562872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:29.621573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1319/2598] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:29.630137 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.630435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.630744 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.649224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:29.650934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:29.662554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1280/2599] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:29.667315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.677209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45f1b-8f50-4329-9dfd-1804e5ba66bf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.681875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.682537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.682821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.683099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.683863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:29.684175 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.685761 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.699390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1320/2600] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:29.702180 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.713071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67b879-53ab-45dd-84da-1805cb75930b None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.718057 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.718741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.719010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.719287 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.720019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.721941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.738798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:29.764626 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1281/2601] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:29 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:29.765792 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.778035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afae823-33de-47a1-a236-a85c90f48aa1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.850529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.851202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.851513 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.851790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.853102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.855180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.874929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1321/2602] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:29 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:29.879064 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.889995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8ea7-66fb-423e-b746-9d6e00f0406f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.894618 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.895270 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.895582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.895886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.896600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.898277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.910135 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1282/2603] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:29.914263 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.920490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:29.924688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c079f3d-208e-4720-acc9-a315d4782d19 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.931193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.932052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.932581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.932913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.933841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.935951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8acd85-c4ef-4527-83a8-c6ca6d4ad9f0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:29.947819 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1322/2604] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:29.952207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:29.963688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62eb42-f21f-4bd7-b4ed-0dcc0225ee5e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:29.968904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:29.969822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:29.970109 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:29.970389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] PATH_INFO: `/v3/projects/8a5f2ad6494b4fc998e1dbd3732d2358/users/44df313988514b27ba2af31b2d28c355/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:29.985387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5f2ad6494b4fc998e1dbd3732d2358, user_id=44df313988514b27ba2af31b2d28c355, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:29.988100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.000482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1283/2605] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:29 2022] PUT /identity/v3/projects/8a5f2ad6494b4fc998e1dbd3732d2358/users/44df313988514b27ba2af31b2d28c355/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:30.013131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.013425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.013710 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.042183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] MFA Rules not processed for user `44df313988514b27ba2af31b2d28c355`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:30.043430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:30.107206 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1323/2606] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:30.111737 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.173752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775e42-58b7-42fb-b25a-e1e04dde8e86 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.178592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.179246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.179564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.179842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.180557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.182668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.207516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1284/2607] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:30.211611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.223128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b156bfe-2e82-4dda-804b-1da5377af7f4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.279069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.279775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.280061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.280337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.281029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.282916 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.302780 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1324/2608] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:30.307629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.318299 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2ace-db0a-4c35-a9b0-992b59720fce admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.323863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.324527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.324835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.325116 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.325844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.327471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.338527 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1285/2609] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:30.342583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.352870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d43c3-22b5-4551-afdc-041c02d88c6e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.357527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.358194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.358481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.358756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.359547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.361136 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194eb56-458a-4759-ae7b-c55d02b28895 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.372246 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1325/2610] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:30.376660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.387634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fb05-fdc3-48e9-b728-686374375ef1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.392660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.393597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.393907 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.394209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] PATH_INFO: `/v3/projects/d9dce0457af84317afcddb2b6cb401c1/users/6f8b4a701be1462396001c74bb92a2e7/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.411319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dce0457af84317afcddb2b6cb401c1, user_id=6f8b4a701be1462396001c74bb92a2e7, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.414279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.428163 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1286/2611] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:30 2022] PUT /identity/v3/projects/d9dce0457af84317afcddb2b6cb401c1/users/6f8b4a701be1462396001c74bb92a2e7/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:30.439905 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.440250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.440536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.469071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] MFA Rules not processed for user `6f8b4a701be1462396001c74bb92a2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:30.470429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:30.519556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:30.539265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1326/2612] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:30.544038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.606154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c08ae-c85d-481e-a760-d4984cb1fd21 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.610926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.611611 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.611899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.612198 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.612879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.614780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.624913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:30.642697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1287/2613] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:30.646839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.657696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed55a5-5016-483f-93b8-e45ead8b6508 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.715700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.716373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.716656 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.716933 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.717633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.719562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.739624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1327/2614] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:30.744337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.754902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6fc1-2ad3-4adb-8965-715b5b54cc03 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.760890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.761551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.761832 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.762104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.762823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.764449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.775684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1288/2615] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:30.779745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.790851 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e6a66-fe6e-4926-af84-9cb113c0d577 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.795720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.796605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.796889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.797170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] PATH_INFO: `/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218/users/8589fa19c19a4757a49e505f2aad2908/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.813277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc354dd9cdb44bdaebc2b211dab3218, user_id=8589fa19c19a4757a49e505f2aad2908, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.816013 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.829532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1328/2616] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:30 2022] PUT /identity/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218/users/8589fa19c19a4757a49e505f2aad2908/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:30.834621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.847530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f62da-5a4b-4497-8783-9b5d62f019d9 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.910177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.910177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.910177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.912505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.912505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.915641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7ec5-9e8a-4991-a3bc-b03f1f927990 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.924888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1289/2617] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:30.929205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:30.940811 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503e5e-0651-4059-a5ac-29b7daa9371d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:30.945545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:30.946463 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.946743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.947015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] PATH_INFO: `/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218/users/8589fa19c19a4757a49e505f2aad2908/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:30.949016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc354dd9cdb44bdaebc2b211dab3218, user_id=8589fa19c19a4757a49e505f2aad2908, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:30.951672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:30.965907 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1329/2618] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:30 2022] PUT /identity/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218/users/8589fa19c19a4757a49e505f2aad2908/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:30.975952 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:30.976367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:30.976713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:31.005600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] MFA Rules not processed for user `8589fa19c19a4757a49e505f2aad2908`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:31.006817 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:31.085546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1290/2619] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:38:31.107485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:31.110628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:31.178029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c469ca-ff80-4e1e-b6a3-6d6bb85093b3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:31.181735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:31.182412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:31.182697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:31.182975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:31.242633 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:31.244268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:31.248621 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:31.256910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1330/2620] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:32.251741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:32.253266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:32.310543 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af88c1-12db-4a52-853a-a25783934b7a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:32.314231 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:32.314885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:32.315169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:32.315474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:32.317264 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:32.330834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:32.381959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:32.383429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:32.393124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1291/2621] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:32.755547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:32.764370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76508-05ac-4098-b49e-33491106fafc service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:32.768090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:32.768740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:32.769027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:32.769307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:32.839339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:32.840855 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:32.850416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1331/2622] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:33.402888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:33.412620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa897f-5a95-4736-9f23-7cb9084ce10c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:33.416258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:33.416902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:33.417186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:33.417460 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:33.426486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:33.427966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:33.438397 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1292/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:38:36.247693 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:36.249269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:36.266573 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928951d-d282-4118-9602-9ca1405a1e0b service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:36.271519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:36.272668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.273025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.273747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] PATH_INFO: `/v3/users/bf8e812b72a3456dbb303f0498b44334` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.276103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8e812b72a3456dbb303f0498b44334)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:36.278105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:36.344078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8e812b72a3456dbb303f0498b44334'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.359680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8e812b72a3456dbb303f0498b44334'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.367865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8e812b72a3456dbb303f0498b44334'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.368827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8e812b72a3456dbb303f0498b44334'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.383029 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9f8a6481-4243-430f-9fc6-e350b3dd8394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8e812b72a3456dbb303f0498b44334'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.390250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1332/2624] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:36 2022] DELETE /identity/v3/users/bf8e812b72a3456dbb303f0498b44334 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:36.571488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:36.582851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699744-94ae-471e-bc12-b032d47ccb90 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:36.642257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:36.643123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.643432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.643710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] PATH_INFO: `/v3/projects/b3669b4153434e93aa29b772cfd78ea4` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.645020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3669b4153434e93aa29b772cfd78ea4)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:36.647045 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:36.693970 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3669b4153434e93aa29b772cfd78ea4', 'request_id': 'req-3e907686-18d3-49bc-8e98-692ebd200714'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.701983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3669b4153434e93aa29b772cfd78ea4', 'request_id': 'req-3e907686-18d3-49bc-8e98-692ebd200714'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.708320 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3669b4153434e93aa29b772cfd78ea4', 'request_id': 'req-3e907686-18d3-49bc-8e98-692ebd200714'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.720590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] The token cache is being invalidate because project b3669b4153434e93aa29b772cfd78ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:36.720879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.721538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e907686-18d3-49bc-8e98-692ebd200714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:36.723088 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1293/2625] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:36 2022] DELETE /identity/v3/projects/b3669b4153434e93aa29b772cfd78ea4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:36.728631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.728921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.729196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.748317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:36.749555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:36.812356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1333/2626] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:36.819713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.820012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.820295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.840025 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:36.841323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:36.849666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1294/2627] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:36.854560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:36.866214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ac82b-a4a6-476a-894e-9d3c64c0e09a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:36.872876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:36.873642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.873991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.874338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.875167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:36.875572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:36.877232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:36.880708 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:36.908059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1334/2628] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:36.909531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:36.919969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0fac9-cba4-4b6f-80ea-ce66e1180d5d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:36.924787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:36.925531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:36.925815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:36.926083 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:36.926776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:36.928763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:36.951154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:36.959678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1295/2629] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:36.964056 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:36.973902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501958f0-27ea-4a51-9dd7-680b4ad22c9a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.031529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.032215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.032502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.032782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.033469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.035380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.055835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1335/2630] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:36 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:37.059882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.070358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f5d02-a8c1-4106-816a-ca50c5c6b9ce admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.075022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.075718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.076002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.076280 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.077037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.078643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.089588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1296/2631] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:37.093202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.103562 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4ebb5-ed68-4dc8-9851-c2877dceffdc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.108176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.108822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.109106 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.109382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.110095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.111747 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cff6d-a64c-4f23-b759-040a216d2281 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.121626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1336/2632] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:37.125442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.135354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c0d6-9331-4507-94cd-4e9ffd915973 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.140245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.141114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.141399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.141675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] PATH_INFO: `/v3/projects/73cb11ee7a674f11b08bf21947fe680a/users/d1caef7300d645689eeed7cee02f513e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.158982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73cb11ee7a674f11b08bf21947fe680a, user_id=d1caef7300d645689eeed7cee02f513e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.161953 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.175509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1297/2633] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:37 2022] PUT /identity/v3/projects/73cb11ee7a674f11b08bf21947fe680a/users/d1caef7300d645689eeed7cee02f513e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:37.185560 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.185849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.186129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.213325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] MFA Rules not processed for user `d1caef7300d645689eeed7cee02f513e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:37.214518 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:37.279201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1337/2634] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:37.291151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.292859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:37.365723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c91b7a-63f3-45a2-92be-13bef75dd36e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.371536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.372187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.372468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.372741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.380387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.381967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a3bc7-effa-465c-8529-39fcb9e0831f service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.391636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1298/2635] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:37.515113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.516549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:37.592289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a0563-a329-4fb9-96f5-0b0c6961ed44 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.596841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.597718 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.597998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.598275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] PATH_INFO: `/v3/users/44df313988514b27ba2af31b2d28c355` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.599545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44df313988514b27ba2af31b2d28c355)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.601489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.606661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:37.654082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44df313988514b27ba2af31b2d28c355'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:37.669159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44df313988514b27ba2af31b2d28c355'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:37.677186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44df313988514b27ba2af31b2d28c355'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:37.678138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44df313988514b27ba2af31b2d28c355'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:37.687382 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44df313988514b27ba2af31b2d28c355'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:37.694196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1338/2636] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:37 2022] DELETE /identity/v3/users/44df313988514b27ba2af31b2d28c355 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:37.699432 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.699886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.700243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.728398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:37.729620 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:37.801960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1299/2637] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:37.812195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:37.813722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:37.871981 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff4ed-6857-46db-bb5a-7df357520d42 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:37.875641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:37.876292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:37.876577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:37.876854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:37.886607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:37.888069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:37.897546 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1339/2638] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:38.160436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:38.162222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:38.176591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63974c8b-b4bf-4f88-9b31-dae1ba67fdca None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:38.182530 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:38.183563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:38.183947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:38.184344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] PATH_INFO: `/v3/projects/8a5f2ad6494b4fc998e1dbd3732d2358` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:38.185903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5f2ad6494b4fc998e1dbd3732d2358)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:38.188182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:38.234919 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:38.238367 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5f2ad6494b4fc998e1dbd3732d2358', 'request_id': 'req-17204cf7-baa3-4465-ab11-643236890eb8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.248517 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5f2ad6494b4fc998e1dbd3732d2358', 'request_id': 'req-17204cf7-baa3-4465-ab11-643236890eb8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.255189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5f2ad6494b4fc998e1dbd3732d2358', 'request_id': 'req-17204cf7-baa3-4465-ab11-643236890eb8'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.266623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] The token cache is being invalidate because project 8a5f2ad6494b4fc998e1dbd3732d2358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:38.266912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.267592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.269134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1300/2639] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:38 2022] DELETE /identity/v3/projects/8a5f2ad6494b4fc998e1dbd3732d2358 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:38.273544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:38.283774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2a289-9343-4f71-a6e7-cb7064127210 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:38.344092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:38.344964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:38.345255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:38.345536 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] PATH_INFO: `/v3/users/6f8b4a701be1462396001c74bb92a2e7` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:38.346729 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8b4a701be1462396001c74bb92a2e7)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:38.348702 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:38.379975 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:38.397989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8b4a701be1462396001c74bb92a2e7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.409804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8b4a701be1462396001c74bb92a2e7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.417461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8b4a701be1462396001c74bb92a2e7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.418113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8b4a701be1462396001c74bb92a2e7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.425380 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8b4a701be1462396001c74bb92a2e7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.432084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1340/2640] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:38 2022] DELETE /identity/v3/users/6f8b4a701be1462396001c74bb92a2e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:38.700687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:38.702249 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:38.716079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17204cf7-baa3-4465-ab11-643236890eb8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:38.774220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:38.775779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:38.776066 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:38.776345 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] PATH_INFO: `/v3/projects/d9dce0457af84317afcddb2b6cb401c1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:38.777544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9dce0457af84317afcddb2b6cb401c1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:38.779505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:38.834100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9dce0457af84317afcddb2b6cb401c1', 'request_id': 'req-66a7f74c-ba8b-40ee-b76b-357910d63dd7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.849072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9dce0457af84317afcddb2b6cb401c1', 'request_id': 'req-66a7f74c-ba8b-40ee-b76b-357910d63dd7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.855984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9dce0457af84317afcddb2b6cb401c1', 'request_id': 'req-66a7f74c-ba8b-40ee-b76b-357910d63dd7'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.868993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] The token cache is being invalidate because project d9dce0457af84317afcddb2b6cb401c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:38.869285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.869934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:38.871511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1301/2641] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:38 2022] DELETE /identity/v3/projects/d9dce0457af84317afcddb2b6cb401c1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:38.875572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:38.877057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:38.890666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b4a6-4302-4eb3-b9f4-7823509aba50 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:38.951888 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:38.953389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:38.953389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:38.953674 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] PATH_INFO: `/v3/users/8589fa19c19a4757a49e505f2aad2908` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:38.954964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8589fa19c19a4757a49e505f2aad2908)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:38.957231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.010214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8589fa19c19a4757a49e505f2aad2908'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.022701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8589fa19c19a4757a49e505f2aad2908'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.031098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8589fa19c19a4757a49e505f2aad2908'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.031834 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8589fa19c19a4757a49e505f2aad2908'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.041597 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f5d68148-0e93-42c8-b82a-20502fa0b917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8589fa19c19a4757a49e505f2aad2908'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.049280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1341/2642] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:38 2022] DELETE /identity/v3/users/8589fa19c19a4757a49e505f2aad2908 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:39.339208 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.341230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:39.354790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7f74c-ba8b-40ee-b76b-357910d63dd7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.417666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.418548 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.418830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.419114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] PATH_INFO: `/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.420577 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc354dd9cdb44bdaebc2b211dab3218)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.422758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.429012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:39.470024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc354dd9cdb44bdaebc2b211dab3218', 'request_id': 'req-9ca60bf7-fabd-436a-9cd8-af024e20fc51'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.476260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc354dd9cdb44bdaebc2b211dab3218', 'request_id': 'req-9ca60bf7-fabd-436a-9cd8-af024e20fc51'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.482005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc354dd9cdb44bdaebc2b211dab3218', 'request_id': 'req-9ca60bf7-fabd-436a-9cd8-af024e20fc51'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.492709 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] The token cache is being invalidate because project 9fc354dd9cdb44bdaebc2b211dab3218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:39.493000 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.494174 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9ca60bf7-fabd-436a-9cd8-af024e20fc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:39.495827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1302/2643] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:39 2022] DELETE /identity/v3/projects/9fc354dd9cdb44bdaebc2b211dab3218 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:39.500700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.501182 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.501279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.519979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:39.521172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:39.539661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:39.582805 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1342/2644] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:39.590682 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.590975 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.591252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.609887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:39.611081 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:39.619763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1303/2645] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:39.623876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.633428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9ad29-60ea-406e-997c-a2f2b85f75b9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.638355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.639001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.639288 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.639604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.640321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:39.640626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.642203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.653979 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1343/2646] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:39.658044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.668184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9575e-3ba9-4cae-bebf-3c7fbdbdfa3d None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.672909 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.673552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.673835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.674108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.674804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.676729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.705303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1304/2647] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:39 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:39.706362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.716692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3651aad-ec62-47a6-9bc9-f8a4a37091ff admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.773351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.773955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.774244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.774526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.775230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.777195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.797628 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1344/2648] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:39 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:39.803627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.816392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07c97a-896c-47f1-80fc-026337bf05d0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.821294 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.822006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.822513 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.822839 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.823605 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.825246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.836217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1305/2649] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:39.840477 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.850908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124201-2c89-4ed8-90d4-d00eec7c611c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.856462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.857128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.857416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.857726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.858457 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.860123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ca0f9-dbbe-4db0-9003-8bbad096f9cb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.870732 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1345/2650] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:39.874760 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:39.885077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcc500-2a83-4bc9-a250-9e5f42c62015 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:39.889683 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:39.890550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.890831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.891106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] PATH_INFO: `/v3/projects/24362db133ef45cc85f6b7051c757367/users/2ac4b3167bbb4f17bcd974e874e72b7e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.905557 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24362db133ef45cc85f6b7051c757367, user_id=2ac4b3167bbb4f17bcd974e874e72b7e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:39.908228 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:39.922707 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1306/2651] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:39 2022] PUT /identity/v3/projects/24362db133ef45cc85f6b7051c757367/users/2ac4b3167bbb4f17bcd974e874e72b7e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:39.927850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d12-8aa6-434f-b0dc-d0bb4695c075 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:39.928141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d12-8aa6-434f-b0dc-d0bb4695c075 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:39.928444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83132d12-8aa6-434f-b0dc-d0bb4695c075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:39.946969 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-83132d12-8aa6-434f-b0dc-d0bb4695c075 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:39.948476 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-83132d12-8aa6-434f-b0dc-d0bb4695c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:40.006550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1346/2652] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:40.015933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:40.017608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:40.075392 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3b31-a0cc-4220-920e-33de4a05ee5d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:40.079005 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:40.079684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:40.079982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:40.080251 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:40.089807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:40.091244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:40.100659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1307/2653] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:40.722727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3bb2-58e2-4f9e-87ce-72f9e6d60cd9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:40.723268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3bb2-58e2-4f9e-87ce-72f9e6d60cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:40.723452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a3bb2-58e2-4f9e-87ce-72f9e6d60cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:40.754555 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d61a3bb2-58e2-4f9e-87ce-72f9e6d60cd9 None None] MFA Rules not processed for user `2ac4b3167bbb4f17bcd974e874e72b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:40.755798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d61a3bb2-58e2-4f9e-87ce-72f9e6d60cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:40.780973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:40.833687 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1347/2654] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:40.844382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:40.846182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:40.886657 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:40.912448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08903b2-0613-476d-b5c1-ea2519078e06 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:40.916054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:40.916698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:40.916988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:40.917260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:40.925827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:40.927258 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:40.936537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1308/2655] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:42.327645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b62c-f5b3-4ea4-a020-c9d0b7902c2d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:42.328192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b62c-f5b3-4ea4-a020-c9d0b7902c2d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:42.328192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205b62c-f5b3-4ea4-a020-c9d0b7902c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:42.345881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7205b62c-f5b3-4ea4-a020-c9d0b7902c2d None None] MFA Rules not processed for user `2ac4b3167bbb4f17bcd974e874e72b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:42.347080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7205b62c-f5b3-4ea4-a020-c9d0b7902c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:42.354077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1348/2656] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:42.618054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:42.618054 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:42.632267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0244-6ba2-4637-8dd1-13d9b4a3ac46 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:42.636806 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:42.637669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:42.637950 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:42.638226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] PATH_INFO: `/v3/users/d1caef7300d645689eeed7cee02f513e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:42.639458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1caef7300d645689eeed7cee02f513e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:42.641375 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:42.691366 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1caef7300d645689eeed7cee02f513e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:42.698932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1caef7300d645689eeed7cee02f513e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:42.711856 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1caef7300d645689eeed7cee02f513e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:42.712808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1caef7300d645689eeed7cee02f513e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:42.720333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1caef7300d645689eeed7cee02f513e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:42.726831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1309/2657] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:42 2022] DELETE /identity/v3/users/d1caef7300d645689eeed7cee02f513e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:42.731945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:42.732344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:42.732647 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:42.752037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:42.753252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:42.821643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1349/2658] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:42.831448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:42.832897 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:42.895069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d232d-c3f6-46f7-9340-3da5757cd15f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:42.898742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:42.899429 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:42.899717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:42.899988 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:42.909995 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:42.911746 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da73c1a-e7db-4101-a729-4b6f15213a62 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:42.922458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1310/2659] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:43.204600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.206105 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:43.219543 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a057-f15b-4f0b-9954-25e9a141080e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.224491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.225313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.225603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.225879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] PATH_INFO: `/v3/projects/73cb11ee7a674f11b08bf21947fe680a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.227083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73cb11ee7a674f11b08bf21947fe680a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.229427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.288902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73cb11ee7a674f11b08bf21947fe680a', 'request_id': 'req-8cd69b52-7a69-4754-b365-b60e7de6064a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:43.295307 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73cb11ee7a674f11b08bf21947fe680a', 'request_id': 'req-8cd69b52-7a69-4754-b365-b60e7de6064a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:43.303274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73cb11ee7a674f11b08bf21947fe680a', 'request_id': 'req-8cd69b52-7a69-4754-b365-b60e7de6064a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:43.316391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] The token cache is being invalidate because project 73cb11ee7a674f11b08bf21947fe680a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:43.316759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:43.317466 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cd69b52-7a69-4754-b365-b60e7de6064a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:43.322929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1350/2660] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:43 2022] DELETE /identity/v3/projects/73cb11ee7a674f11b08bf21947fe680a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:43.324589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.324946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.325307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.344085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:43.345669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:43.398807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:43.418073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1311/2661] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:43.425823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.426280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.426383 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.445037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:43.446235 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:43.455795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1351/2662] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:43.460133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.472369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc71de0-f846-4a84-88ae-a37178463815 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.477998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.478735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.479023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.479302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.480072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:43.480381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.482234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.494540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1312/2663] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:43.498852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.509675 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92765b73-472a-40d4-bcaf-814fca2f9ac9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.514782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.515379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.515672 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.515945 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.516638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.518757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.547268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1352/2664] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:38:43.551590 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.561946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e593cc-800f-4098-a713-5cc6ecff66dc admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.626920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.627643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.628015 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.628298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.628994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.630947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.656049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1313/2665] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:43.657451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.668284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9986b-6d30-4a93-be42-8f8d4f6d6c2e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.673180 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.674070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.674392 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.674721 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.675571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.677731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.680109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:43.691545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1353/2666] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:43.695659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.706713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3e2f9-1b9b-4e1c-940e-3dcaff8c9853 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.713099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.713776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.714059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.714335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.715065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.716722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84342c7-9c79-43c9-8211-aa1a9e959cf6 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.726991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1314/2667] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:43.731095 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.741132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77def7fb-f2b9-46fa-851f-589b89265561 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.746596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.747539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.747844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.748103 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] PATH_INFO: `/v3/projects/b9bdd47652564e77b732a4862e8bed6b/users/27336d66c1824ec79f19918f367f505e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.763934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9bdd47652564e77b732a4862e8bed6b, user_id=27336d66c1824ec79f19918f367f505e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.766673 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.780803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1354/2668] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:43 2022] PUT /identity/v3/projects/b9bdd47652564e77b732a4862e8bed6b/users/27336d66c1824ec79f19918f367f505e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:43.791578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d251-3576-4be7-8639-866fed08398c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.791948 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d251-3576-4be7-8639-866fed08398c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.792197 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d251-3576-4be7-8639-866fed08398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.820156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-8df7d251-3576-4be7-8639-866fed08398c None None] MFA Rules not processed for user `27336d66c1824ec79f19918f367f505e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:43.821418 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8df7d251-3576-4be7-8639-866fed08398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:43.888820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1315/2669] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:43.893357 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:43.955006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7498-430f-4c82-b2b3-256aafac4a31 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:43.959731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:43.960388 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:43.960701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:43.960984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:43.961667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:43.963619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:43.988754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1355/2670] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:43.992772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d251-3576-4be7-8639-866fed08398c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.004194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d251-3576-4be7-8639-866fed08398c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.047311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:44.061767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.062440 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.062724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.063006 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.063743 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.065677 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.086123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1316/2671] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:43 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:44.090199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.100455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd10d42-5825-4561-a8d3-212ea4b1fa99 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.105571 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.106243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.106527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.106807 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.107598 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.109268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.120864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1356/2672] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:44.124809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.134838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290170e-82b0-4d0a-9dcd-29d04f8c4cd4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.139551 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.140448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.140733 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.141019 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] PATH_INFO: `/v3/projects/2b5b29b87b014025a37fb55fa645a21a/users/a54aaac57ef24b18ac455b38ee45390e/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.158455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5b29b87b014025a37fb55fa645a21a, user_id=a54aaac57ef24b18ac455b38ee45390e, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.161442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.175240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1317/2673] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:44 2022] PUT /identity/v3/projects/2b5b29b87b014025a37fb55fa645a21a/users/a54aaac57ef24b18ac455b38ee45390e/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:44.180170 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.192203 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bab3b-c007-4c7c-b63f-7e00cd0688d1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.255245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.256014 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.256302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.256582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.257323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.258970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960c2aa-030b-4187-bad7-1fb1417399f3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.270073 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1357/2674] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:44.276520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.293824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76629d5-1321-4753-bee3-18aa6430c187 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.300226 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.301398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.302592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.303047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] PATH_INFO: `/v3/projects/2b5b29b87b014025a37fb55fa645a21a/users/a54aaac57ef24b18ac455b38ee45390e/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.307729 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5b29b87b014025a37fb55fa645a21a, user_id=a54aaac57ef24b18ac455b38ee45390e, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.311148 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.328173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1318/2675] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:44 2022] PUT /identity/v3/projects/2b5b29b87b014025a37fb55fa645a21a/users/a54aaac57ef24b18ac455b38ee45390e/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:44.339953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.340375 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.340799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.377934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] MFA Rules not processed for user `a54aaac57ef24b18ac455b38ee45390e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:44.379406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:44.416722 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:44.455217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1358/2676] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:44.465983 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.467845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:44.531819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6e90a-cf3c-4e45-ad3c-ca037d2adff7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.535585 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.536499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.536785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.537065 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.548276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.549730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52753d3-f699-4e67-900a-358653b75645 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.560859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1319/2677] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:44.706676 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.773866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71087c6e-cb03-4ac7-ba24-c543d9f3a090 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:44.778917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:44.780048 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.780187 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.780444 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] PATH_INFO: `/v3/users/27336d66c1824ec79f19918f367f505e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.781648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27336d66c1824ec79f19918f367f505e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:44.783627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:44.833850 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27336d66c1824ec79f19918f367f505e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:44.847286 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27336d66c1824ec79f19918f367f505e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:44.855847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27336d66c1824ec79f19918f367f505e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:44.856491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27336d66c1824ec79f19918f367f505e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:44.865424 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27336d66c1824ec79f19918f367f505e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:44.872901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1359/2678] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:44 2022] DELETE /identity/v3/users/27336d66c1824ec79f19918f367f505e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:44.880436 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:44.880908 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:44.881173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:44.900524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:44.902140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:44.963354 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1320/2679] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:44.972810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:44.974232 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:45.030264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:45.035498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e690a-6f44-46e9-aa2a-cf83e515b88e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:45.041614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:45.042607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:45.043479 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:45.043844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:45.053865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:45.055306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:45.065887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1360/2680] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:45.627024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:45.628555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:45.641285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871005-8d38-4901-afd8-367a1c08efab None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:45.646452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:45.647336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:45.647669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:45.648031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] PATH_INFO: `/v3/projects/b9bdd47652564e77b732a4862e8bed6b` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:45.649455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9bdd47652564e77b732a4862e8bed6b)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:45.652221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:45.694857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:45.707474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9bdd47652564e77b732a4862e8bed6b', 'request_id': 'req-6084b47a-77d4-43ff-b1f9-eb031f1095e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.716694 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9bdd47652564e77b732a4862e8bed6b', 'request_id': 'req-6084b47a-77d4-43ff-b1f9-eb031f1095e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.723757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9bdd47652564e77b732a4862e8bed6b', 'request_id': 'req-6084b47a-77d4-43ff-b1f9-eb031f1095e5'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.736855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] The token cache is being invalidate because project b9bdd47652564e77b732a4862e8bed6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:45.736960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.738102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.739985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1321/2681] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:45 2022] DELETE /identity/v3/projects/b9bdd47652564e77b732a4862e8bed6b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:45.744724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:45.756987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa96e5-5e79-40b2-9721-ceb728e0d671 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:45.817200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:45.818082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:45.818364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:45.818638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] PATH_INFO: `/v3/users/a54aaac57ef24b18ac455b38ee45390e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:45.820397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54aaac57ef24b18ac455b38ee45390e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:45.823427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:45.871489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54aaac57ef24b18ac455b38ee45390e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.883131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54aaac57ef24b18ac455b38ee45390e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.891299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54aaac57ef24b18ac455b38ee45390e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.892030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54aaac57ef24b18ac455b38ee45390e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.900960 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-efeceb1c-1b95-47e1-99e0-ed5858d47163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54aaac57ef24b18ac455b38ee45390e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:45.908534 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1361/2682] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:45 2022] DELETE /identity/v3/users/a54aaac57ef24b18ac455b38ee45390e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:46.189100 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.190721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.205582 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084b47a-77d4-43ff-b1f9-eb031f1095e5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.263989 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.264847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.265124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.265390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] PATH_INFO: `/v3/projects/2b5b29b87b014025a37fb55fa645a21a` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.266581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5b29b87b014025a37fb55fa645a21a)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.268552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.314715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5b29b87b014025a37fb55fa645a21a', 'request_id': 'req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:46.322783 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5b29b87b014025a37fb55fa645a21a', 'request_id': 'req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:46.328326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5b29b87b014025a37fb55fa645a21a', 'request_id': 'req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:46.339531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] The token cache is being invalidate because project 2b5b29b87b014025a37fb55fa645a21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:46.339821 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:46.340454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-571d1d5c-2f1f-44b1-ae16-f86049f10a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:46.341982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1322/2683] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:46 2022] DELETE /identity/v3/projects/2b5b29b87b014025a37fb55fa645a21a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:46.346779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.347070 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.347349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.365958 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:46.367167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.425936 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1362/2684] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:46.434184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.434469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.434747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.453322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:46.454523 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.462348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1323/2685] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:38:46.466564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.476259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaee48-caa8-4b2d-8f0a-1d5b9ec95242 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.481670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.482325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.482611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.482919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.483689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:46.484000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.485595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.492293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:46.499208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1363/2686] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:46.503229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.512555 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8822929-a056-42c7-949c-4a129a368e09 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.517161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.517807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.518092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.518369 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.519062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.521001 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.546535 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1324/2687] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:46 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:46.550748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.561344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480aeb1-cf0e-4b6a-a26d-0740664cb380 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.618735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.620145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.620429 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.620712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.621404 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.623311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.644254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1364/2688] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:46 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:46.648346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.658693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b836af-af87-4cf1-838e-e28db863da87 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.663643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.664304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.664587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.664858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.665580 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.668328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.679212 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1325/2689] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:46.680275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.682682 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.683718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.693576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454d27-b100-4dca-a670-c7dd50b6d799 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.698519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.699177 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.699495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.699772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.700489 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.702086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.712224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1326/2690] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:46.717246 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.723592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:46.727797 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659477cd-0704-4d8b-8fef-df8bb3e74232 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.735890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.736801 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.737150 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.737724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] PATH_INFO: `/v3/projects/45f39a702e9b4b8885abdb5f97c64ec3/users/95437b7905ab47a1b02eee1d662c7e14/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.747240 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d9b5-4116-4d96-b6ba-d8dd99647835 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:46.750904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:46.751584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.751873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.752163 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.753566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f39a702e9b4b8885abdb5f97c64ec3, user_id=95437b7905ab47a1b02eee1d662c7e14, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.753934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.756648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59f9bf-b1ef-48de-a3cc-66a35f06009f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.771703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1327/2691] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:46 2022] PUT /identity/v3/projects/45f39a702e9b4b8885abdb5f97c64ec3/users/95437b7905ab47a1b02eee1d662c7e14/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:38:46.782027 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:46.782319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:46.782595 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:46.810298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] MFA Rules not processed for user `95437b7905ab47a1b02eee1d662c7e14`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:46.811818 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.832017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:46.833454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:46.844495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1365/2692] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:46.877579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1328/2693] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:38:46.890321 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:46.891791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:46.923567 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:46.949968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57176f06-b785-4e3e-a81e-2fb78e9fa621 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:47.003009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:47.003692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:47.003977 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:47.004253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:47.013484 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:47.014902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:47.023712 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1366/2694] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:50.351863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:50.408905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b8cc-c261-4628-b5ff-22cd5330d233 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:50.413522 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:50.414186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:50.414474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:50.414969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:50.417933 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:50.491924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:50.493373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023ee2c-8c20-4b32-b22c-94e76fee5c1e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:50.505602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1329/2695] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:52.352550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:52.416599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e559c9b-a5ac-40d3-a990-cb432aa2f0b9 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:52.421149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:52.422016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:52.422301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:52.422579 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] PATH_INFO: `/v3/users/95437b7905ab47a1b02eee1d662c7e14` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:52.423796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=95437b7905ab47a1b02eee1d662c7e14)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:52.425723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:52.470948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95437b7905ab47a1b02eee1d662c7e14'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:52.482962 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95437b7905ab47a1b02eee1d662c7e14'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:52.489690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95437b7905ab47a1b02eee1d662c7e14'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:52.490349 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95437b7905ab47a1b02eee1d662c7e14'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:52.497932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95437b7905ab47a1b02eee1d662c7e14'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:52.503932 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1367/2696] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:52 2022] DELETE /identity/v3/users/95437b7905ab47a1b02eee1d662c7e14 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:52.508423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:52.508889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:52.509010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:52.526787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:52.528018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:52.532934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:52.588281 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1330/2697] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:52.597754 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:52.599172 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:52.609576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:52.661369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc170d-a64f-48b0-850b-99c1df7ee5df admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:52.664995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:52.665930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:52.666218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:52.666495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:52.675252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:52.676758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeeb668-a345-4747-b915-b157b7b2217f service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:52.687339 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1368/2698] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:52.961021 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:52.962525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:52.984395 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303443e-aa2f-4047-94f0-859f3d658105 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:52.991646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:52.992524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:52.992807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:52.993086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] PATH_INFO: `/v3/projects/45f39a702e9b4b8885abdb5f97c64ec3` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:52.994820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f39a702e9b4b8885abdb5f97c64ec3)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:52.996833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.046492 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f39a702e9b4b8885abdb5f97c64ec3', 'request_id': 'req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.054885 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f39a702e9b4b8885abdb5f97c64ec3', 'request_id': 'req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.061928 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f39a702e9b4b8885abdb5f97c64ec3', 'request_id': 'req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.073785 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] The token cache is being invalidate because project 45f39a702e9b4b8885abdb5f97c64ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:53.074078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.074890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8984df7c-366e-41e4-96c8-f28cf2dc4fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.076578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1331/2699] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:52 2022] DELETE /identity/v3/projects/45f39a702e9b4b8885abdb5f97c64ec3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:53.081736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.082028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.082309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.100911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:53.102025 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:53.162755 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1369/2700] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:53.172647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.172939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.173210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.193023 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:53.194255 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:53.206994 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1332/2701] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:53.207810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.218010 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660e8da-e63e-4e5f-8e02-6eaf17e3fb51 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.222642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.223301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.223607 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.223881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.224610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:53.224915 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.226511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.242791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1370/2702] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:38:53.244607 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.253879 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93f998-0fe3-45ac-8ade-2ecf951c32f4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.258588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.259342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.259652 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.260002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.260711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.262659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.287295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1333/2703] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:53.292132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.302341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859f915-61bf-4645-8d30-445b11c23b0f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.360486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.361197 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.361489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.361767 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.362468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.364587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.385998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1371/2704] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:53.393078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.404075 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e7f4-ebdd-4286-a549-3f458a36ce2d admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.410031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.411062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.411224 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.411575 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.412621 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.414130 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.428126 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1334/2705] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:53.429817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.440790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376ce88-8ce0-4bda-9274-80f9e1418246 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.445449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.446113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.446400 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.446742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.447686 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.449275 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773ef23-66df-4f8b-9e3a-b6b2491323e9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.462788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1372/2706] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:53.464183 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.474824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41bece-36a5-4e82-95e6-72f933f4a138 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.481244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.482132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.482417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.482691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] PATH_INFO: `/v3/projects/eaf265f1f38a41e79c5d89fb8d4e3c59/users/3d9a8fb5fea840d09fec516037b418d4/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.499274 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf265f1f38a41e79c5d89fb8d4e3c59, user_id=3d9a8fb5fea840d09fec516037b418d4, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.502067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.527634 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1335/2707] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:53 2022] PUT /identity/v3/projects/eaf265f1f38a41e79c5d89fb8d4e3c59/users/3d9a8fb5fea840d09fec516037b418d4/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:53.538038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.538316 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.538617 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.567616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] MFA Rules not processed for user `3d9a8fb5fea840d09fec516037b418d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:53.568836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:53.573370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:53.645100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1373/2708] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:53.677289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.679106 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:53.717227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:53.742552 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5f18-19cd-4938-91b6-54782a3f5449 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.746420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.747067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.747352 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.747668 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.755895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.757332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1ed9a-20d8-4367-b677-709368bf52f5 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.766138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1336/2709] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:53.780387 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:53.843472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf42d8-6825-4a04-bc9d-8b42d610cd42 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:53.847939 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:53.848813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.849096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.849369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] PATH_INFO: `/v3/users/3d9a8fb5fea840d09fec516037b418d4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.850532 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9a8fb5fea840d09fec516037b418d4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:53.852468 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:53.897110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9a8fb5fea840d09fec516037b418d4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.909417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9a8fb5fea840d09fec516037b418d4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.916584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9a8fb5fea840d09fec516037b418d4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.917236 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9a8fb5fea840d09fec516037b418d4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.924220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9a8fb5fea840d09fec516037b418d4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:53.930028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1374/2710] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:53 2022] DELETE /identity/v3/users/3d9a8fb5fea840d09fec516037b418d4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:53.934722 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:53.935063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:53.935349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:53.952881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:53.954067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.012758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1337/2711] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:54.022213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.023715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.052169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:54.083964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898806e-f1a3-498b-8616-ea271bc33b39 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.088247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.088887 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.089169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.089445 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.098300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.099750 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6b62-f784-4534-930e-8ed789571e89 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.108984 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1375/2712] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:54.373464 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.374927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.389254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f8212-aeea-4397-982b-c554c3e27c84 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.394363 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.395435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.395717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.395977 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] PATH_INFO: `/v3/projects/eaf265f1f38a41e79c5d89fb8d4e3c59` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.397171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf265f1f38a41e79c5d89fb8d4e3c59)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.399085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.445196 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf265f1f38a41e79c5d89fb8d4e3c59', 'request_id': 'req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:54.453166 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf265f1f38a41e79c5d89fb8d4e3c59', 'request_id': 'req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:54.458742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf265f1f38a41e79c5d89fb8d4e3c59', 'request_id': 'req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:54.470218 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] The token cache is being invalidate because project eaf265f1f38a41e79c5d89fb8d4e3c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:54.470505 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:54.471143 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-28eb9c48-6742-4d9c-a07d-a0c8f024cd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:54.472726 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1338/2713] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:54 2022] DELETE /identity/v3/projects/eaf265f1f38a41e79c5d89fb8d4e3c59 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:54.478407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.478873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.478990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.497317 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:54.498510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.558735 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1376/2714] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:54.566773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.567303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.567303 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.586504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:54.587812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.595653 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1339/2715] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:54.599774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.609881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79700-01a0-41ae-bab1-813e1e1e983e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.614478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.615128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.615451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.615737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.616493 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:38:54.616800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.618393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.630270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1377/2716] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:38:54.634847 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.644062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc859ea3-1ed4-4f11-8242-db4c112ec7b8 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.648964 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.649616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.649979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.650241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.650941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.652890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.678187 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1340/2717] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:54.683149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.693097 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2135d6-2b39-4181-9ef6-905cbc5ade58 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.752210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.752882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.753164 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.753441 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.754129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.756069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.776082 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1378/2718] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:38:54.780278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.791296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825db5a-60d3-4a21-97f3-0900958398d3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.796152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.796816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.797101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.797377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.798108 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.799770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.811290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1341/2719] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:38:54.815102 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.826323 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34f2f6-486b-4b39-b205-4ce12f98f096 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.831450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.832133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.832421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.832699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.833427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.835022 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313b30d-92dc-4eba-8fb0-8727ac2ff241 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.846009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1379/2720] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:38:54.849979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:54.860794 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15ef9-de7a-458a-bf24-cb38377dffda admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:54.866271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:54.867161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.867476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.867755 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] PATH_INFO: `/v3/projects/d0d81081f84d4414b6408416f7ab3423/users/5f827138f6d0418d9adbf830eb2d7d9e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.883095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d81081f84d4414b6408416f7ab3423, user_id=5f827138f6d0418d9adbf830eb2d7d9e, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:54.886458 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:54.888667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:54.901257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1342/2721] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:38:54 2022] PUT /identity/v3/projects/d0d81081f84d4414b6408416f7ab3423/users/5f827138f6d0418d9adbf830eb2d7d9e/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:54.912522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:54.912882 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:54.913167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:54.945284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] MFA Rules not processed for user `5f827138f6d0418d9adbf830eb2d7d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:54.946505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:54.967925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:55.014199 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1380/2722] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:55.025423 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:55.027121 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:55.084570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd6d2f-cb94-4b2a-8e27-0eb4e20e659e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:55.088364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:55.089009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:55.089295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:55.089573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:55.097921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:55.099373 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5047-8093-4704-ad4d-2041a78a6856 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:55.108171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1343/2723] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:55.133098 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:55.195925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cadc8-517d-4196-ad31-a92b096b6d1b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:55.200706 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:55.201585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:55.201870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:55.202146 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] PATH_INFO: `/v3/users/5f827138f6d0418d9adbf830eb2d7d9e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:55.203356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f827138f6d0418d9adbf830eb2d7d9e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:55.205306 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:55.253369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f827138f6d0418d9adbf830eb2d7d9e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.265425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f827138f6d0418d9adbf830eb2d7d9e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.272458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f827138f6d0418d9adbf830eb2d7d9e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.273152 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f827138f6d0418d9adbf830eb2d7d9e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.280764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f827138f6d0418d9adbf830eb2d7d9e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.286908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1381/2724] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:38:55 2022] DELETE /identity/v3/users/5f827138f6d0418d9adbf830eb2d7d9e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:55.292060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:55.292349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:55.292629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:55.309499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:55.310689 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:55.371553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1344/2725] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:55.381194 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:55.382595 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:55.431490 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:55.445839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd39a8-f39a-4d81-9524-b43ee23b3b41 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:55.450697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:55.451350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:55.451660 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:55.451934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:55.461788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:55.463800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:55.473553 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1382/2726] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:55.757865 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:55.760240 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:55.773380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34bf26-20b4-4d0f-a00c-7f435951dd40 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:55.789003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:55.789929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:55.790165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:55.790594 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] PATH_INFO: `/v3/projects/d0d81081f84d4414b6408416f7ab3423` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:55.792703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d81081f84d4414b6408416f7ab3423)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:55.794671 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:55.848243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d81081f84d4414b6408416f7ab3423', 'request_id': 'req-afe1da71-3138-47fb-8bdd-8020f0fb982d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.856029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d81081f84d4414b6408416f7ab3423', 'request_id': 'req-afe1da71-3138-47fb-8bdd-8020f0fb982d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.862348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d81081f84d4414b6408416f7ab3423', 'request_id': 'req-afe1da71-3138-47fb-8bdd-8020f0fb982d'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.874627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] The token cache is being invalidate because project d0d81081f84d4414b6408416f7ab3423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:38:55.875110 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.876210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-afe1da71-3138-47fb-8bdd-8020f0fb982d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:38:55.878007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1345/2727] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:38:55 2022] DELETE /identity/v3/projects/d0d81081f84d4414b6408416f7ab3423 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:38:56.088703 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:56.091558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:56.177903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f66e1a-e4f6-4edc-9f1d-fa20753c7dfc service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:56.246221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:56.246880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:56.247165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:56.247486 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:56.249255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:56.261524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:56.263092 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:56.273670 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1383/2728] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:57.151742 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:57.152222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:57.152340 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:57.171579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] MFA Rules not processed for user `2ac4b3167bbb4f17bcd974e874e72b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:38:57.172781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:57.186095 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:57.230076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1346/2729] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:38:57.453320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:57.454760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:57.511104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7161b-c542-40a6-972a-4e11ece0faee service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:57.514709 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:57.515352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:57.515723 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:57.516003 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:57.517762 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:57.531196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:57.533452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:57.542610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1384/2730] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:57.866296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:57.867959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:57.940872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1115a0-8505-43f4-bb81-584c50820452 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:57.945884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:57.946602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:57.946890 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:57.947169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:57.948980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:57.960221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:57.961814 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:57.972189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1347/2731] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:38:59.623944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:38:59.625467 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:59.636759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c4b2d-5505-42e5-88b4-030bb3785121 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:38:59.640609 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:38:59.641260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:38:59.641547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:38:59.641823 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:38:59.643599 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:38:59.653277 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:38:59.654690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a118-f8fb-46db-921e-46c7ac432ce0 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:38:59.657764 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:38:59.664101 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1385/2732] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:06.643900 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:06.645716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:06.674751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b4c1f-04f8-4151-ba35-5bbd124279bf service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:06.684275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:06.685339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:06.685846 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:06.686347 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:06.689232 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:06.714720 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:06.716576 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:06.727969 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1348/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:39:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:09.661510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:15.152520 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9688-b244-44b5-ad17-7f907ff4f406 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:15.153080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9688-b244-44b5-ad17-7f907ff4f406 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:15.153080 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9688-b244-44b5-ad17-7f907ff4f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:15.171594 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-616f9688-b244-44b5-ad17-7f907ff4f406 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:15.172799 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-616f9688-b244-44b5-ad17-7f907ff4f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:15.228857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1386/2734] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:15.275679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:15.277193 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:15.350125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149fa39-960d-430b-94fb-43c5775051e8 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:15.355204 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:15.355881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:15.356168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:15.356443 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:15.364452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:15.366038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:15.374515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1349/2735] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:39:25.222142 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=25 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:25.371334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=86 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:30.729506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:30.729970 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:30.730196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:30.747913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:30.749100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:30.756338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1387/2736] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:39:30.769010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:30.780250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074d46e-afd2-4b94-84ec-e71c9800bdf3 service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:30.785593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:30.786230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:30.786515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:30.786816 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:30.795635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:30.797229 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:30.805520 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1350/2737] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:39:32.696821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:32.698304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:32.769026 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de8a3-5728-4935-9cfc-b063654ad444 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:32.773689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:32.775215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:32.775694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:32.775999 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] PATH_INFO: `/v3/users/2ac4b3167bbb4f17bcd974e874e72b7e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:32.777314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac4b3167bbb4f17bcd974e874e72b7e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:32.779386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:32.830711 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac4b3167bbb4f17bcd974e874e72b7e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:32.843104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac4b3167bbb4f17bcd974e874e72b7e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:32.849908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac4b3167bbb4f17bcd974e874e72b7e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:32.850587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac4b3167bbb4f17bcd974e874e72b7e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:32.858626 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-31951654-9919-4d68-aaea-8e7c09a4142b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac4b3167bbb4f17bcd974e874e72b7e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:32.864618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1388/2738] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:39:32 2022] DELETE /identity/v3/users/2ac4b3167bbb4f17bcd974e874e72b7e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:39:33.043169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.054428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23636e73-29a4-45d3-9ab4-e2f9a4fab05f service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.115298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.116188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.116468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.116741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] PATH_INFO: `/v3/projects/24362db133ef45cc85f6b7051c757367` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.117974 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24362db133ef45cc85f6b7051c757367)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.120094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.166060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24362db133ef45cc85f6b7051c757367', 'request_id': 'req-2eca4373-ff3a-4472-9d32-4d7b0387ad63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:33.173114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24362db133ef45cc85f6b7051c757367', 'request_id': 'req-2eca4373-ff3a-4472-9d32-4d7b0387ad63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:33.178624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24362db133ef45cc85f6b7051c757367', 'request_id': 'req-2eca4373-ff3a-4472-9d32-4d7b0387ad63'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:33.190271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] The token cache is being invalidate because project 24362db133ef45cc85f6b7051c757367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:39:33.190559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:33.191191 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-2eca4373-ff3a-4472-9d32-4d7b0387ad63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:39:33.193092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1351/2739] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:39:33 2022] DELETE /identity/v3/projects/24362db133ef45cc85f6b7051c757367 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:39:33.198784 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.199078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.199386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.217774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:33.218953 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:33.277432 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1389/2740] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:33.285374 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.285715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.285941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.304496 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:33.306420 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:33.314642 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1352/2741] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:33.318949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.329305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6434d-ae9d-45ff-b2e4-e9f616f6dd09 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.333847 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.334496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.334778 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.335054 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.335813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:39:33.336113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.337809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.346204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:33.350416 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1390/2742] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:39:33.354757 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.364002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7f68e-bb4f-41ea-bbf4-0afb570fdd37 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.369531 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.370171 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.370453 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.370727 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.371450 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.373351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.398169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1353/2743] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:39:33 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:39:33.402353 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.412576 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e932-eb69-4462-9de0-d4ebacc7747f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.469368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.470039 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.470331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.470605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.471299 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.473221 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.494684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1391/2744] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:39:33 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:39:33.497297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.508031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb5732-1b16-48eb-be6a-4707f6697324 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.512998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.513741 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.514085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.514396 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.515156 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.516956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.528646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1354/2745] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:39:33.532512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.543281 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ac8d3-f570-4056-97e7-93ee158c1279 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.547901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.548558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.548846 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.549124 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.549844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.551456 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b00e2-a3e8-4393-ae89-325159e73402 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.562344 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1392/2746] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:39:33.566315 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.577474 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a083f-24c9-419c-a453-14a7b36eb50b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.582309 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.583236 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.583581 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.583863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] PATH_INFO: `/v3/projects/50346c626b9f42599d65f861a20cb7d1/users/2502ad0a67d247b2a1713aa35ed84052/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.599770 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50346c626b9f42599d65f861a20cb7d1, user_id=2502ad0a67d247b2a1713aa35ed84052, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.602448 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.614991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1355/2747] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:39:33 2022] PUT /identity/v3/projects/50346c626b9f42599d65f861a20cb7d1/users/2502ad0a67d247b2a1713aa35ed84052/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:39:33.620171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d10e71-d5fd-4400-a5aa-ada8e97bf932 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.620465 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d10e71-d5fd-4400-a5aa-ada8e97bf932 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.620751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d10e71-d5fd-4400-a5aa-ada8e97bf932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.638852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a0d10e71-d5fd-4400-a5aa-ada8e97bf932 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:33.640071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a0d10e71-d5fd-4400-a5aa-ada8e97bf932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:33.698777 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1393/2748] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:33.708820 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:33.710574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:33.725554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:33.770491 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93b64-f371-4cfa-8b20-8608756300c1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:33.774254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:33.775629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:33.775918 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:33.776199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:33.785601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:33.787043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:33.796753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1356/2749] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:34.410876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc000-0896-43f3-ae8f-5af25d90dd5c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:34.411192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc000-0896-43f3-ae8f-5af25d90dd5c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:34.411624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc000-0896-43f3-ae8f-5af25d90dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:34.440615 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c0cdc000-0896-43f3-ae8f-5af25d90dd5c None None] MFA Rules not processed for user `2502ad0a67d247b2a1713aa35ed84052`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:34.441817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c0cdc000-0896-43f3-ae8f-5af25d90dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:34.509166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1394/2750] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:34.519380 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:34.520804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:34.581507 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c158-468b-42a8-8ac7-75bdd775856b service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:34.585080 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:34.585751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:34.586039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:34.586316 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:34.595267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:34.596784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:34.606776 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1357/2751] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:39:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:35.946605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d229af-4e02-45bb-804b-41025c5b376d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:35.947133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d229af-4e02-45bb-804b-41025c5b376d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:35.947247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d229af-4e02-45bb-804b-41025c5b376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:35.973293 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-53d229af-4e02-45bb-804b-41025c5b376d None None] MFA Rules not processed for user `2502ad0a67d247b2a1713aa35ed84052`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:35.974489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-53d229af-4e02-45bb-804b-41025c5b376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:35.987120 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1395/2752] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:36.234071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:36.235844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:36.249084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77ffce-b116-4bd2-8004-354653be53d9 service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:36.253415 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:36.254480 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:36.254769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:36.255050 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:36.256896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:36.267384 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:36.269099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:36.278046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1358/2753] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:43.260756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:43.261297 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:43.261412 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:43.267207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:43.281049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] MFA Rules not processed for user `f83f354cdfc54c49b9cb71a07dea4454`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:39:43.282247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:43.340545 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1396/2754] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:39:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:39:46.273800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=52 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:49.798147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:49.806774 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27c5f3-0dfa-4e6f-9f97-9dc4d1434a4c service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:49.811124 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:49.811799 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:49.812084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:49.812357 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:49.814307 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:49.827244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:49.828936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b53e08-4785-4e43-a539-e6262ca36467 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:49.838242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1359/2755] 10.222.0.46 () {60 vars in 1396 bytes} [Mon May 23 15:39:49 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:39:53.332365 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=24 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:54.692109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:39:54.693577 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:54.833245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3fa38-ca9f-48f2-b8fa-f48c066979e1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:39:54.839079 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:39:54.840618 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:39:54.840903 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:39:54.841184 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:39:54.843868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:39:54.856913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:39:54.858492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:39:54.869572 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1397/2756] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:39:59.834168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:04.864614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=56 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:13.162435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752603-3412-4d5f-89c6-e0ebd10fc649 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:13.162991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752603-3412-4d5f-89c6-e0ebd10fc649 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:13.162991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752603-3412-4d5f-89c6-e0ebd10fc649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:13.232571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c4752603-3412-4d5f-89c6-e0ebd10fc649 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:13.233778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c4752603-3412-4d5f-89c6-e0ebd10fc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:13.260697 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1360/2757] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:13.285791 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:13.297220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55ecdb-2f9b-4d23-8ac5-e50b4cb2a87e service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:13.302659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:13.303304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:13.303627 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:13.303904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:13.312717 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:13.314287 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:13.323822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1398/2758] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:17.228695 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99c3f-c498-4b36-ae63-542f3036eb5b None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:17.229242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99c3f-c498-4b36-ae63-542f3036eb5b None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:17.229242 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d99c3f-c498-4b36-ae63-542f3036eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:17.247936 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-48d99c3f-c498-4b36-ae63-542f3036eb5b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:17.249132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-48d99c3f-c498-4b36-ae63-542f3036eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:17.257012 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1361/2759] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:17.279094 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:17.280716 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:17.295612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d27e9-e537-4efc-9206-8e38fef1f7f8 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:17.301135 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:17.301775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:17.302061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:17.302340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:17.310720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:17.312311 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:17.321696 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1399/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:21.472176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b3b41-d048-474a-9084-c6131db49030 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:21.472740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b3b41-d048-474a-9084-c6131db49030 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:21.472740 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b3b41-d048-474a-9084-c6131db49030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:21.491167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-990b3b41-d048-474a-9084-c6131db49030 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:21.492836 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-990b3b41-d048-474a-9084-c6131db49030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:21.501400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1362/2761] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:21.523190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:21.535220 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50877517-1e68-4af9-9361-4b70a7469e2a service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:21.541041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:21.541775 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:21.542166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:21.542653 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:21.552266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:21.553836 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:21.564503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1400/2762] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:24.537276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9ed4-1747-472e-b47c-29333222672a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:24.537764 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9ed4-1747-472e-b47c-29333222672a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:24.537881 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a9ed4-1747-472e-b47c-29333222672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:24.556749 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-575a9ed4-1747-472e-b47c-29333222672a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:24.557958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-575a9ed4-1747-472e-b47c-29333222672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:24.566673 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1363/2763] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:24.588084 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:24.599982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892e116-1ec2-4b47-b9ac-54c9ff86df93 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:24.605446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:24.606083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:24.606364 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:24.606639 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:24.616772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:24.618333 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:24.628001 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1401/2764] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:28.722795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e03d03-6758-4455-8319-246be9a69d77 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:28.723289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e03d03-6758-4455-8319-246be9a69d77 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:28.723435 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e03d03-6758-4455-8319-246be9a69d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:28.742167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-96e03d03-6758-4455-8319-246be9a69d77 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:28.743393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-96e03d03-6758-4455-8319-246be9a69d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:28.751417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1364/2765] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:28.774601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:28.788198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef0a23-fb89-4810-89c0-77b9136c87b8 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:28.793759 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:28.794406 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:28.794694 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:28.794973 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:28.804083 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:28.805700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:28.815857 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1402/2766] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:32.901486 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6035c-578f-463a-9281-8af0b37ab37d None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:32.902004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6035c-578f-463a-9281-8af0b37ab37d None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:32.902107 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6035c-578f-463a-9281-8af0b37ab37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:32.920217 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-ddb6035c-578f-463a-9281-8af0b37ab37d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:32.921997 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ddb6035c-578f-463a-9281-8af0b37ab37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:32.929941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1365/2767] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:32.959381 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:40:32.970921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f4c0d-d2ca-417d-b92f-0eb740990273 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:40:32.976358 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:40:32.976993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:32.977274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:32.977549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:32.986666 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:40:32.988296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae66f5-0b7a-4383-8143-d9051d0e694a service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:40:32.998009 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1403/2768] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:40:42.915011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=45 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:42.993568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=36 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:40:49.125718 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:40:49.126201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:40:49.126310 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:40:49.143612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] MFA Rules not processed for user `2502ad0a67d247b2a1713aa35ed84052`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:40:49.144812 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:40:49.151719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1366/2769] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:40:59.138485 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:02.831870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936328-8f6b-4ee9-b102-1c33cf010709 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:02.832295 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936328-8f6b-4ee9-b102-1c33cf010709 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:02.832495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b936328-8f6b-4ee9-b102-1c33cf010709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:02.851248 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7b936328-8f6b-4ee9-b102-1c33cf010709 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:02.852602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7b936328-8f6b-4ee9-b102-1c33cf010709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:02.860373 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1404/2770] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:41:02.880398 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:02.900244 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8708b69-742b-4348-88f2-85c478edffd6 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:02.905666 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:02.906297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:02.906578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:02.906853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:02.916142 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:02.917715 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:02.927094 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1367/2771] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:07.117015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817856b0-8fbf-45f5-8f3f-24a82eef4f2d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:07.117657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817856b0-8fbf-45f5-8f3f-24a82eef4f2d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:07.117657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817856b0-8fbf-45f5-8f3f-24a82eef4f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:07.135060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-817856b0-8fbf-45f5-8f3f-24a82eef4f2d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:07.136285 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-817856b0-8fbf-45f5-8f3f-24a82eef4f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:07.144289 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1405/2772] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:07.166922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:07.178146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2781d0-08f5-4ed9-97a4-217c92eebd02 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:07.184385 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:07.185049 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:07.185334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:07.185613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:07.193824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:07.195584 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:07.205055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1368/2773] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:11.220815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad085-9544-41c0-a332-51f5a4f0eb4b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:11.221356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad085-9544-41c0-a332-51f5a4f0eb4b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:11.221356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bad085-9544-41c0-a332-51f5a4f0eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:11.239160 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-64bad085-9544-41c0-a332-51f5a4f0eb4b None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:11.240362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-64bad085-9544-41c0-a332-51f5a4f0eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:11.248623 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1406/2774] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:11.275030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:11.289090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447182c-0d35-489f-82fa-7a249bb5ac50 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:11.294674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:11.295318 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:11.295644 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:11.295924 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:11.304982 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:11.306571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:11.316356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1369/2775] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:15.399900 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58cf1a-6019-4c2f-97f9-063e5b251647 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:15.400399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58cf1a-6019-4c2f-97f9-063e5b251647 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:15.400512 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58cf1a-6019-4c2f-97f9-063e5b251647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:15.419643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4c58cf1a-6019-4c2f-97f9-063e5b251647 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:15.420843 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4c58cf1a-6019-4c2f-97f9-063e5b251647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:15.429529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1407/2776] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:15.453387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:15.465721 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8192c2-f9cf-4cdb-bbcf-0e6db5a0c87e service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:15.471151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:15.471823 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:15.472111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:15.472390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:15.481030 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:15.482613 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:15.492853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1370/2777] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:19.577752 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:19.578227 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:19.578342 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:19.596425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:19.597624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:19.605926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1408/2778] 10.222.0.70 () {58 vars in 1016 bytes} [Mon May 23 15:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:19.627082 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:19.639528 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3910eb-070a-49b3-9279-8d375ac2a5ee service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:19.644998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:19.645641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:19.645921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:19.646194 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:19.654456 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:19.656073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:19.665898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1371/2779] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:29.591410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=15 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:29.661378 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=33 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:48.498548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:48.517840 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90353-43ca-401a-91d2-b68d5b1caf32 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:48.521417 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:48.522053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:48.522337 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:48.522614 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:48.524389 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:48.536883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:48.538290 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:48.548619 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1409/2780] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:41:51.753639 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:51.755916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:51.781834 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e08c-19a4-4757-a331-e1a3171099ab service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:51.795304 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:51.796278 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:51.796571 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:51.796852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] PATH_INFO: `/v3/users/f83f354cdfc54c49b9cb71a07dea4454` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:51.798099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83f354cdfc54c49b9cb71a07dea4454)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:51.800317 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:51.863250 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83f354cdfc54c49b9cb71a07dea4454'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:51.872824 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83f354cdfc54c49b9cb71a07dea4454'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:51.888938 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83f354cdfc54c49b9cb71a07dea4454'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:51.890099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83f354cdfc54c49b9cb71a07dea4454'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:51.899888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83f354cdfc54c49b9cb71a07dea4454'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:51.911455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1372/2781] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:41:51 2022] DELETE /identity/v3/users/f83f354cdfc54c49b9cb71a07dea4454 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:51.932390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:51.943110 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75279f6f-9f0c-4021-8e7d-eceacd164957 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.005605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.006964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.007250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.007559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] PATH_INFO: `/v3/users/2502ad0a67d247b2a1713aa35ed84052` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.008820 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2502ad0a67d247b2a1713aa35ed84052)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.010742 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.061904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2502ad0a67d247b2a1713aa35ed84052'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.074393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2502ad0a67d247b2a1713aa35ed84052'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.082922 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2502ad0a67d247b2a1713aa35ed84052'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.083664 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2502ad0a67d247b2a1713aa35ed84052'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.091556 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4976c805-ff2e-44e0-a01a-5efd75720446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2502ad0a67d247b2a1713aa35ed84052'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.098244 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1410/2782] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:41:51 2022] DELETE /identity/v3/users/2502ad0a67d247b2a1713aa35ed84052 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:52.103887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.105473 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.119754 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cf465-4c89-4811-8603-2849461247a7 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.181563 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.182500 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.182784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.183071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] PATH_INFO: `/v3/projects/3a26b6365ad840fda40f17fa52a1558e` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.184463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a26b6365ad840fda40f17fa52a1558e)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.186389 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.234446 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a26b6365ad840fda40f17fa52a1558e', 'request_id': 'req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.242407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a26b6365ad840fda40f17fa52a1558e', 'request_id': 'req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.250717 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a26b6365ad840fda40f17fa52a1558e', 'request_id': 'req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.261944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] The token cache is being invalidate because project 3a26b6365ad840fda40f17fa52a1558e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:41:52.262253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.263289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.265351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1373/2783] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:41:52 2022] DELETE /identity/v3/projects/3a26b6365ad840fda40f17fa52a1558e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:52.270336 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a49b-1e1a-4cae-87ea-2b36b62a8c74 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.270629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a49b-1e1a-4cae-87ea-2b36b62a8c74 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.270914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7a49b-1e1a-4cae-87ea-2b36b62a8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.291229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b4d7a49b-1e1a-4cae-87ea-2b36b62a8c74 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:52.292478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b4d7a49b-1e1a-4cae-87ea-2b36b62a8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.295387 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.296867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.302929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:52.348821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:52.363684 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1411/2784] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:41:52.368937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.369258 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.369559 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.376007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff16b1e-e9ba-40c1-81dd-f17699b95e13 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.380777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.381650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.381935 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.382207 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] PATH_INFO: `/v3/projects/50346c626b9f42599d65f861a20cb7d1` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.383428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] RBAC: Authorizing `identity:delete_project(project_id=50346c626b9f42599d65f861a20cb7d1)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.385350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.388873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:52.390071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.398788 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1412/2785] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:52.402745 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.412876 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f136466-1f01-4cd0-9499-fd48a566ab9d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.417894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.418875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.419192 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.419473 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.420201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:41:52.420514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.422114 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.437911 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1413/2786] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 23 15:41:52.438085 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50346c626b9f42599d65f861a20cb7d1', 'request_id': 'req-1cd57bb7-5920-4f36-bd2f-679b1d37523b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.439419 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.444670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50346c626b9f42599d65f861a20cb7d1', 'request_id': 'req-1cd57bb7-5920-4f36-bd2f-679b1d37523b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.449190 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c253f7-6426-425c-9b9b-b04155508416 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.451540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50346c626b9f42599d65f861a20cb7d1', 'request_id': 'req-1cd57bb7-5920-4f36-bd2f-679b1d37523b'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.464067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] The token cache is being invalidate because project 50346c626b9f42599d65f861a20cb7d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:41:52.464356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.465013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:41:52.467152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1374/2787] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:41:52 2022] DELETE /identity/v3/projects/50346c626b9f42599d65f861a20cb7d1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:52.516724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.517319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.517604 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.517883 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.518588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.520544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.552657 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1414/2788] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:41:52.556923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.558495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.573331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57bb7-5920-4f36-bd2f-679b1d37523b admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.636431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.637684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.638463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.638463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.638946 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.640986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.663679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1375/2789] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:41:52.667904 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.678768 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89196c16-6051-421c-ae7a-623972d6be0d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.683929 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.684629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.685071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.685350 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.686129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.687817 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.698917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1415/2790] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:52.703874 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.714390 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca75e02-1afc-4c38-a7e8-1a26c3456a81 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.719932 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.720635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.720931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.721431 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.722243 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.724112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec79226-b0eb-4697-8457-3e16e3a5e992 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.735058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1376/2791] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:52.739430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.749804 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2d4e9-9e62-44d1-b39d-34318a2e8cb4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.754511 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.755455 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.755746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.756027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] PATH_INFO: `/v3/projects/04be4a54ae0d4f3c939e4049ffbff1bf/users/713d3e60e7e54f62b129f16eabd449f6/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.771030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04be4a54ae0d4f3c939e4049ffbff1bf, user_id=713d3e60e7e54f62b129f16eabd449f6, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.773662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:52.787596 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1416/2792] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:41:52 2022] PUT /identity/v3/projects/04be4a54ae0d4f3c939e4049ffbff1bf/users/713d3e60e7e54f62b129f16eabd449f6/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:52.797798 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.798323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.798426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.817944 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:52.827791 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] MFA Rules not processed for user `713d3e60e7e54f62b129f16eabd449f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:52.829748 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:52.896134 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1377/2793] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:52.900880 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:52.969613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dd3fa-72a7-469d-8beb-6afbca0e5647 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:52.974262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:52.974917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:52.975200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:52.975501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:52.976201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:52.978078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.003442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1417/2794] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:41:52 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:41:53.007511 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.018176 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015a95-8551-4d3f-a4a9-52d8256724d4 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.074376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.075013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.075471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.075777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.076549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.078518 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.098564 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1378/2795] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:41:53 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:41:53.102503 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.113812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd962bb4-4e11-453a-b464-35fe1c1e18b2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.118464 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.119121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.119454 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.119720 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.120471 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.122111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.132612 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1418/2796] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:53.136495 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.146635 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec07a-0bf7-4b3b-b78a-a008a0e258c1 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.151379 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.152257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.152544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.153359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] PATH_INFO: `/v3/projects/328f3f8ea2444d999448d741e9efd52a/users/13d7d80b73b54f72bccdd64b063c1f09/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.168221 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328f3f8ea2444d999448d741e9efd52a, user_id=13d7d80b73b54f72bccdd64b063c1f09, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.171784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.184407 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1379/2797] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:41:53 2022] PUT /identity/v3/projects/328f3f8ea2444d999448d741e9efd52a/users/13d7d80b73b54f72bccdd64b063c1f09/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:41:53.188418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.193581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:53.199967 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8ef47-d3c8-4cab-bf57-cf6b0bca3eda admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.256196 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.256869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.257158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.257439 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.258167 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.259873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8b45-e8e1-4553-8ab6-608e90920f5e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.270044 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1419/2798] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:41:53.274674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.285920 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206d71f-4174-4931-9d43-0924dc858261 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.290641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.291602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.291888 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.292167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] PATH_INFO: `/v3/projects/328f3f8ea2444d999448d741e9efd52a/users/13d7d80b73b54f72bccdd64b063c1f09/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.295007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328f3f8ea2444d999448d741e9efd52a, user_id=13d7d80b73b54f72bccdd64b063c1f09, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.297691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.307967 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1380/2799] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:41:53 2022] PUT /identity/v3/projects/328f3f8ea2444d999448d741e9efd52a/users/13d7d80b73b54f72bccdd64b063c1f09/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:41:53.319313 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.319667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.319949 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.346894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] MFA Rules not processed for user `13d7d80b73b54f72bccdd64b063c1f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:41:53.348052 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:53.417071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1420/2800] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:41:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:41:53.429649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.431381 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:41:53.490506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:53.512225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eafea1-4916-4c55-a2f4-2ff700d135c4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.516209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.516844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.517127 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.517403 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.526322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.527790 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.537753 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1381/2801] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:41:53.613428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:41:53.624537 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6883-2e37-400d-a288-a807b0e6d8b3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:41:53.628266 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:41:53.628924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:41:53.629210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:41:53.629485 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:41:53.685844 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:41:53.687270 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1b41-e367-4a0d-b657-270bb3b577f5 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:41:53.696207 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1421/2802] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:41:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:00.389169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:00.450267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd856-1acf-43fb-b397-4b8e5ec64fba service cinder] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:00.455445 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:00.456308 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:00.456587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:00.456859 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] PATH_INFO: `/v3/users/713d3e60e7e54f62b129f16eabd449f6` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:00.458026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713d3e60e7e54f62b129f16eabd449f6)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:00.459985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:00.506118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713d3e60e7e54f62b129f16eabd449f6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:00.512840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713d3e60e7e54f62b129f16eabd449f6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:00.524986 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713d3e60e7e54f62b129f16eabd449f6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:00.525646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713d3e60e7e54f62b129f16eabd449f6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:00.532830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713d3e60e7e54f62b129f16eabd449f6'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:00.538939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1382/2803] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:00 2022] DELETE /identity/v3/users/713d3e60e7e54f62b129f16eabd449f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:00.543510 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:00.543971 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:00.544151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:00.562386 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:00.563613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:00.579798 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:00.623006 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1422/2804] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:00.632591 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:00.633993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:00.694132 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:00.706263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd6c34-d9b8-4b76-a004-bfbcb9152525 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:00.709927 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:00.710600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:00.710882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:00.711157 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:00.720628 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:00.722102 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:00.731465 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1383/2805] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:01.005948 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.007384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:01.021705 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d90766-67bc-472b-a1a5-495df0b83f4e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.027071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.027863 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.028269 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.028542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] PATH_INFO: `/v3/projects/04be4a54ae0d4f3c939e4049ffbff1bf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.030325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=04be4a54ae0d4f3c939e4049ffbff1bf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.033396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.081558 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04be4a54ae0d4f3c939e4049ffbff1bf', 'request_id': 'req-00bdd025-8dbd-4fd1-88bc-613792c90bcd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.087076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04be4a54ae0d4f3c939e4049ffbff1bf', 'request_id': 'req-00bdd025-8dbd-4fd1-88bc-613792c90bcd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.094908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04be4a54ae0d4f3c939e4049ffbff1bf', 'request_id': 'req-00bdd025-8dbd-4fd1-88bc-613792c90bcd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.106620 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] The token cache is being invalidate because project 04be4a54ae0d4f3c939e4049ffbff1bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:01.106913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.107601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.109173 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1423/2806] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:01 2022] DELETE /identity/v3/projects/04be4a54ae0d4f3c939e4049ffbff1bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:01.113154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.122842 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa608-1799-44c1-8bc4-43d5960effea service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.179376 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.180259 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.180537 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.180822 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] PATH_INFO: `/v3/users/13d7d80b73b54f72bccdd64b063c1f09` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.182016 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d7d80b73b54f72bccdd64b063c1f09)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.183993 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.231654 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d7d80b73b54f72bccdd64b063c1f09'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.238670 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d7d80b73b54f72bccdd64b063c1f09'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.250899 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d7d80b73b54f72bccdd64b063c1f09'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.251596 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d7d80b73b54f72bccdd64b063c1f09'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.258972 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-9a8b88f1-d5ed-466a-977b-6352968df592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d7d80b73b54f72bccdd64b063c1f09'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.265600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1384/2807] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:01 2022] DELETE /identity/v3/users/13d7d80b73b54f72bccdd64b063c1f09 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:01.532608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.534140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:01.547659 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdd025-8dbd-4fd1-88bc-613792c90bcd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.606218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.607093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.607396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.609590 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] PATH_INFO: `/v3/projects/328f3f8ea2444d999448d741e9efd52a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.610800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=328f3f8ea2444d999448d741e9efd52a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.612766 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.656813 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:01.658069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328f3f8ea2444d999448d741e9efd52a', 'request_id': 'req-42492ea4-b5cf-49f3-af11-84f13b018e1f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.664611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328f3f8ea2444d999448d741e9efd52a', 'request_id': 'req-42492ea4-b5cf-49f3-af11-84f13b018e1f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.672884 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328f3f8ea2444d999448d741e9efd52a', 'request_id': 'req-42492ea4-b5cf-49f3-af11-84f13b018e1f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.683874 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] The token cache is being invalidate because project 328f3f8ea2444d999448d741e9efd52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:01.684161 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.684782 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-42492ea4-b5cf-49f3-af11-84f13b018e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:01.687053 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1424/2808] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:01 2022] DELETE /identity/v3/projects/328f3f8ea2444d999448d741e9efd52a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:01.692835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130864df-151a-4e39-900d-061ff25975ec None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.693408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130864df-151a-4e39-900d-061ff25975ec None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.693408 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130864df-151a-4e39-900d-061ff25975ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.711047 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-130864df-151a-4e39-900d-061ff25975ec None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:01.712254 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-130864df-151a-4e39-900d-061ff25975ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:01.771867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1385/2809] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:01.779919 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.780213 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.780501 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.801685 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:01.802825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:01.812017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1425/2810] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:01.816223 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130864df-151a-4e39-900d-061ff25975ec None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.826042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130864df-151a-4e39-900d-061ff25975ec None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.830606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.831279 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.831587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.831858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.832574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:42:01.832875 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.834463 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.836002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:01.851188 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1386/2811] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:42:01.852278 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.861926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06ceb0-c403-44c6-8df0-0463621b17f4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.866498 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.867143 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.867458 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.867736 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.868427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.870366 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.896645 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1426/2812] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:01 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:42:01.900612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:01.911230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755a21-fa18-4648-8780-523dcf4aadf3 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:01.969667 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:01.970341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:01.970627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:01.970906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:01.971641 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:01.973650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:01.995442 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1387/2813] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:01 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:01.999852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.010262 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036543b4-155b-421c-acdc-0ea56a637dc5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.015150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.015845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.016126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.016399 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.017159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.018757 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.029237 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1427/2814] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:02.034037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.044147 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a6273-dc86-4e67-9497-59934209daf5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.049640 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.050311 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.050597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.050870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.051633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.053559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf1f11-791e-401f-bb3a-2c8f58f277fd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.065046 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1388/2815] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:02.069362 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.079508 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e712120-9947-446f-a458-1749066e2c59 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.084505 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.085410 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.085697 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.085966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] PATH_INFO: `/v3/projects/4e001f349a664809b6aa2463f774181c/users/6701ee90ffde4df8a5ef024dc805e772/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.102195 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e001f349a664809b6aa2463f774181c, user_id=6701ee90ffde4df8a5ef024dc805e772, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.104995 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.118727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1428/2816] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:02 2022] PUT /identity/v3/projects/4e001f349a664809b6aa2463f774181c/users/6701ee90ffde4df8a5ef024dc805e772/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:02.130404 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.130700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.130984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.157962 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] MFA Rules not processed for user `6701ee90ffde4df8a5ef024dc805e772`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:02.159173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:02.225225 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1389/2817] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:02.229845 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.292661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518b571-9f5d-492d-af8a-6990e6cd1029 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.298254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.298927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.299218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.299541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.300280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.302208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.327801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1429/2818] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:02 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:02.331804 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.343449 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee49024-2d8a-4f42-8d0c-f2788f19b40c None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.398519 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.399186 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.399504 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.399781 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.400476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.402401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.410854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.423424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1390/2819] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:02 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:02.427274 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.439264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e02f9-ab27-4376-b9e7-d494e642860c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.444168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.444861 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.445144 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.445414 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.446133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.447774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.458267 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1430/2820] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:02.462296 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.472454 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca0fd7-8346-4ad2-9b18-4b8a8c8b44d0 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.477052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.477929 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.478234 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.478484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] PATH_INFO: `/v3/projects/134b930e4ff1461fb731cbffa869c1f5/users/9c420e0d46a04934ba686506bc2c2f44/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.493609 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] RBAC: Authorizing `identity:create_grant(project_id=134b930e4ff1461fb731cbffa869c1f5, user_id=9c420e0d46a04934ba686506bc2c2f44, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.496333 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.509838 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1391/2821] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:02 2022] PUT /identity/v3/projects/134b930e4ff1461fb731cbffa869c1f5/users/9c420e0d46a04934ba686506bc2c2f44/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:02.513737 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.523803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4fa26-11b9-4a37-8dd8-232ee13c9aec admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.567390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.582529 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.583137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.583461 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.583746 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.584469 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.586099 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42397ee-446c-4e3d-a97e-54f38d367c64 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.596121 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1431/2822] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:02.600202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.611052 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b13e9-5b87-408b-b8f4-f65c090e818f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.615704 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.616588 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.616863 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.617140 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] PATH_INFO: `/v3/projects/134b930e4ff1461fb731cbffa869c1f5/users/9c420e0d46a04934ba686506bc2c2f44/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.619103 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=134b930e4ff1461fb731cbffa869c1f5, user_id=9c420e0d46a04934ba686506bc2c2f44, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.621787 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.632482 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1392/2823] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:02 2022] PUT /identity/v3/projects/134b930e4ff1461fb731cbffa869c1f5/users/9c420e0d46a04934ba686506bc2c2f44/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:02.642688 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.642985 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.643268 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.669418 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] MFA Rules not processed for user `9c420e0d46a04934ba686506bc2c2f44`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:02.671158 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:02.740384 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1432/2824] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:02.751777 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.753570 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:02.813382 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664952-e7ae-462e-807e-07d2a291a55a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.817113 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.817765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.818058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.818335 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.827815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.829368 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63294be6-df40-470c-8a43-e9f968f9dcf6 service cinder] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:02.838889 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1393/2825] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:02.902470 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:02.965341 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96bd4d-7c99-47a8-a37f-c3b88cd89539 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:02.970740 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:02.971642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:02.971926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:02.972198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] PATH_INFO: `/v3/users/6701ee90ffde4df8a5ef024dc805e772` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:02.973385 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6701ee90ffde4df8a5ef024dc805e772)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:02.975280 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:03.019526 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6701ee90ffde4df8a5ef024dc805e772'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.032041 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6701ee90ffde4df8a5ef024dc805e772'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.036700 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:03.040393 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6701ee90ffde4df8a5ef024dc805e772'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.041340 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6701ee90ffde4df8a5ef024dc805e772'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.049051 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6701ee90ffde4df8a5ef024dc805e772'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.054966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1433/2826] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:02 2022] DELETE /identity/v3/users/6701ee90ffde4df8a5ef024dc805e772 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:03.059468 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:03.059763 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:03.060055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:03.078028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:03.079215 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:03.136633 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1394/2827] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:03.146644 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:03.148123 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:03.206165 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c491fe-41da-4897-b4fb-708925d36377 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:03.209899 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:03.210541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:03.210821 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:03.211093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:03.220810 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:03.222309 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:03.231869 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1434/2828] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:03.493619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:03.495182 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:03.508853 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38c0b-bf09-48bc-9c3b-d518b7081e10 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:03.513627 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:03.515322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:03.515636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:03.515915 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] PATH_INFO: `/v3/projects/4e001f349a664809b6aa2463f774181c` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:03.517131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e001f349a664809b6aa2463f774181c)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:03.519058 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:03.567433 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e001f349a664809b6aa2463f774181c', 'request_id': 'req-cb7134b4-848f-4ff8-9b12-af34d774fd3c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.569906 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:03.575469 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e001f349a664809b6aa2463f774181c', 'request_id': 'req-cb7134b4-848f-4ff8-9b12-af34d774fd3c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.582807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e001f349a664809b6aa2463f774181c', 'request_id': 'req-cb7134b4-848f-4ff8-9b12-af34d774fd3c'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.594022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] The token cache is being invalidate because project 4e001f349a664809b6aa2463f774181c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:03.594312 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.594965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.596578 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1395/2829] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:03 2022] DELETE /identity/v3/projects/4e001f349a664809b6aa2463f774181c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:42:03.600629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:03.610741 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ed86d-ee4d-44cb-892f-9c82c3d6f4de service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:03.667726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:03.668663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:03.668896 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:03.669177 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] PATH_INFO: `/v3/users/9c420e0d46a04934ba686506bc2c2f44` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:03.670379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c420e0d46a04934ba686506bc2c2f44)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:03.672603 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:03.718250 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c420e0d46a04934ba686506bc2c2f44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.730541 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c420e0d46a04934ba686506bc2c2f44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.737351 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c420e0d46a04934ba686506bc2c2f44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.738017 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c420e0d46a04934ba686506bc2c2f44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.745057 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a5c3e40c-63e7-406b-96fa-2b1fff85d6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c420e0d46a04934ba686506bc2c2f44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:03.751497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1435/2830] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:03 2022] DELETE /identity/v3/users/9c420e0d46a04934ba686506bc2c2f44 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:04.021265 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.022800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:04.036338 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7134b4-848f-4ff8-9b12-af34d774fd3c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.097206 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.098069 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.098359 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.098638 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] PATH_INFO: `/v3/projects/134b930e4ff1461fb731cbffa869c1f5` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.099858 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] RBAC: Authorizing `identity:delete_project(project_id=134b930e4ff1461fb731cbffa869c1f5)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.101813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.149650 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134b930e4ff1461fb731cbffa869c1f5', 'request_id': 'req-d0e0579e-910b-4697-9dc4-8706596bcbee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:04.158293 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134b930e4ff1461fb731cbffa869c1f5', 'request_id': 'req-d0e0579e-910b-4697-9dc4-8706596bcbee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:04.164267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134b930e4ff1461fb731cbffa869c1f5', 'request_id': 'req-d0e0579e-910b-4697-9dc4-8706596bcbee'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:04.175536 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] The token cache is being invalidate because project 134b930e4ff1461fb731cbffa869c1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80365) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:04.175827 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:04.176471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d0e0579e-910b-4697-9dc4-8706596bcbee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:04.178028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1396/2831] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:04 2022] DELETE /identity/v3/projects/134b930e4ff1461fb731cbffa869c1f5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:04.183069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.183397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.183713 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.202826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:04.204037 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:04.208325 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:04.265600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1436/2832] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:04.273405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.273769 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.274048 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.292830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:04.294014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:04.302220 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1397/2833] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:04.306391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.316662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ade1c-925d-41e3-8e65-59b3d60be137 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.321202 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.321848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.322131 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.322407 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.323151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:42:04.323488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.325059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.337231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1437/2834] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:42:04.341566 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.352089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a254c0-3f8b-43b1-b698-08a830ba0816 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.356985 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.357738 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.358063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.358339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.359029 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.361020 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.385991 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1398/2835] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:04.391030 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.401109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d965ce-687a-4fad-a374-408392221846 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.457689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.458264 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.458549 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.458822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.459544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.461431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.481753 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1438/2836] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:42:04.485926 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.496158 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d90d97-081b-40f2-a311-ab70ea3fe92a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.501616 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.502268 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.502553 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.502830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.503599 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.505205 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.516647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1399/2837] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:04.520305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.530185 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e882433-789a-4530-8638-f2a617d068e2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.535036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.535726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.536015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.536300 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.537023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.538624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793b37-6af9-4e86-9fbd-e8c83a5952f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.548831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1439/2838] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:04.552711 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.563302 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c74e3-e1d4-4f39-b63b-4d98b45946a8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.568008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.568882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.569160 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.569459 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] PATH_INFO: `/v3/projects/3860d2461f28467a812a367e6d01be53/users/084bd02ab9ed4f3cbf9dd41171ba3c95/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.585260 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3860d2461f28467a812a367e6d01be53, user_id=084bd02ab9ed4f3cbf9dd41171ba3c95, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.587957 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.600152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1400/2839] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:04 2022] PUT /identity/v3/projects/3860d2461f28467a812a367e6d01be53/users/084bd02ab9ed4f3cbf9dd41171ba3c95/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:04.611841 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.612331 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.612434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.638831 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] MFA Rules not processed for user `084bd02ab9ed4f3cbf9dd41171ba3c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:04.640100 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:04.705028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1440/2840] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:04.709619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.718630 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:04.774043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6304-448b-4129-b206-429f5d46b7b2 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.778679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.779332 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.779779 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.780291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] PATH_INFO: `/v3/projects` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.781004 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.782904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.809297 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1401/2841] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:04.814015 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.820873 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:04.825602 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503e2f8-c016-4a1f-85e0-5134dda7595b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.883133 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.883849 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.884140 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.884421 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.885117 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.887027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.906690 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1441/2842] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:04 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 23 15:42:04.910979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.922010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248fd8-4389-4d7b-9dc5-b2f4503a423e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.926693 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.927348 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.927665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.927942 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.928675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.930277 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.941372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1402/2843] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:04.945478 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:04.955453 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c245c-925b-4c02-b309-c9462bc88a94 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:04.960254 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:04.961078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:04.961361 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:04.961638 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] PATH_INFO: `/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039/users/816371cad1ee435595b4e71b83074874/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:04.976809 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef4aee82f3f4bf79c2e03d78a1db039, user_id=816371cad1ee435595b4e71b83074874, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:04.979629 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:04.992587 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1442/2844] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:04 2022] PUT /identity/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039/users/816371cad1ee435595b4e71b83074874/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:04.996497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:05.006803 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dd8c5-54a0-4b0d-97f1-18efe657326c admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:05.065089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:05.066430 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.066877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.067151 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.067904 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:05.069499 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed1a2-7463-4db6-b16e-c79d51870204 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:05.079905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1403/2845] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:05.084183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:05.095209 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ee077-c46e-42b6-ae4c-65ebd7f65529 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:05.099848 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:05.100724 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.101007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.101284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] PATH_INFO: `/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039/users/816371cad1ee435595b4e71b83074874/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.103243 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef4aee82f3f4bf79c2e03d78a1db039, user_id=816371cad1ee435595b4e71b83074874, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:05.105898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:05.117038 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1443/2846] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:05 2022] PUT /identity/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039/users/816371cad1ee435595b4e71b83074874/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:05.126931 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.127393 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.127688 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.153323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] MFA Rules not processed for user `816371cad1ee435595b4e71b83074874`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:05.155086 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:05.222583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1404/2847] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:42:05.233533 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:05.235247 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:05.291796 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972296-d844-432c-a11f-d25aa6c45139 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:05.296035 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8345ccaca544058ac7df6888e6ab9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:05.296678 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.296964 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.297230 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.306181 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:05.307631 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b8b74-8232-4488-a3c4-69dfc9b91c4e service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:05.317322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1444/2848] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:05.668018 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:05.672678 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:05.733586 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26d54a-1add-4f37-9a95-4f273c94f7e1 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:05.738084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:05.738963 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.739241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.739550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] PATH_INFO: `/v3/users/084bd02ab9ed4f3cbf9dd41171ba3c95` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.740735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084bd02ab9ed4f3cbf9dd41171ba3c95)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:05.742655 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:05.790059 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084bd02ab9ed4f3cbf9dd41171ba3c95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:05.797022 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084bd02ab9ed4f3cbf9dd41171ba3c95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:05.808857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084bd02ab9ed4f3cbf9dd41171ba3c95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:05.809561 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084bd02ab9ed4f3cbf9dd41171ba3c95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:05.816949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084bd02ab9ed4f3cbf9dd41171ba3c95'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:05.823092 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1405/2849] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:05 2022] DELETE /identity/v3/users/084bd02ab9ed4f3cbf9dd41171ba3c95 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:05.828215 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.828663 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.828763 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.846941 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:05.848166 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:05.898076 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:05.907408 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1445/2850] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:05.917202 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:05.918647 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:05.976325 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942059-c077-4cbb-8701-a82fb221c477 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:05.979947 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:05.980593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:05.980878 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:05.981154 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:05.990298 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:05.991730 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:06.001949 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1406/2851] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:06.287774 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:06.289205 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:06.302154 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92821d30-a8af-46c7-b83a-5ea601aa8fdd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:06.306828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:06.307738 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:06.308023 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:06.308304 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] PATH_INFO: `/v3/projects/3860d2461f28467a812a367e6d01be53` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:06.309661 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3860d2461f28467a812a367e6d01be53)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:06.312305 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:06.358588 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3860d2461f28467a812a367e6d01be53', 'request_id': 'req-56434d13-a4ea-475d-8f1c-1f34b40309a9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.364122 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3860d2461f28467a812a367e6d01be53', 'request_id': 'req-56434d13-a4ea-475d-8f1c-1f34b40309a9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.371060 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3860d2461f28467a812a367e6d01be53', 'request_id': 'req-56434d13-a4ea-475d-8f1c-1f34b40309a9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.394547 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] The token cache is being invalidate because project 3860d2461f28467a812a367e6d01be53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:06.394838 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.395538 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.397145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1446/2852] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:06 2022] DELETE /identity/v3/projects/3860d2461f28467a812a367e6d01be53 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:06.401168 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:06.411976 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a589468-7852-4d8f-83dc-33a6db88844b service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:06.432370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:06.472101 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:06.472965 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:06.473241 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:06.473509 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] PATH_INFO: `/v3/users/816371cad1ee435595b4e71b83074874` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:06.474674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816371cad1ee435595b4e71b83074874)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:06.476629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:06.521687 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816371cad1ee435595b4e71b83074874'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.528830 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816371cad1ee435595b4e71b83074874'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.541747 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816371cad1ee435595b4e71b83074874'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.542346 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816371cad1ee435595b4e71b83074874'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.550011 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-d7a77ec5-4846-43e4-853e-584dcc29f8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816371cad1ee435595b4e71b83074874'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.556007 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1407/2853] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:42:06 2022] DELETE /identity/v3/users/816371cad1ee435595b4e71b83074874 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:06.819139 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:06.820624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:06.836837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56434d13-a4ea-475d-8f1c-1f34b40309a9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:06.895427 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:06.896363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:06.896648 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:06.896926 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] PATH_INFO: `/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:06.898113 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef4aee82f3f4bf79c2e03d78a1db039)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:06.900064 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:06.945937 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef4aee82f3f4bf79c2e03d78a1db039', 'request_id': 'req-8bd5affc-751a-4db7-ba2b-277f5829669a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.951895 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef4aee82f3f4bf79c2e03d78a1db039', 'request_id': 'req-8bd5affc-751a-4db7-ba2b-277f5829669a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.958968 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef4aee82f3f4bf79c2e03d78a1db039', 'request_id': 'req-8bd5affc-751a-4db7-ba2b-277f5829669a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.970550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] The token cache is being invalidate because project 9ef4aee82f3f4bf79c2e03d78a1db039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:42:06.970835 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.971495 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8bd5affc-751a-4db7-ba2b-277f5829669a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:42:06.973018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1447/2854] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:42:06 2022] DELETE /identity/v3/projects/9ef4aee82f3f4bf79c2e03d78a1db039 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:06.977912 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:06.978184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:06.978477 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:06.995470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:06.996692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:07.056133 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1408/2855] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:07.064481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.064756 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.065077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.083585 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:07.084815 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:07.093314 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1448/2856] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:42:07.097444 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.106981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6f21-0102-4a6e-8816-a9c52216a2ff None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.111648 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.112301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.112587 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.112866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.113589 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:42:07.113898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.115538 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.127521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1409/2857] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:42:07.131701 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.141677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfb251-a6d7-424d-a998-41f6ffcf80c3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.146284 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.146927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.147208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.147514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.148204 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.150067 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.153255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:07.176938 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1449/2858] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:07.181230 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.191608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97804-ca6f-43f2-9809-9347bd39946f admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.221592 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:07.250669 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.251341 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.251659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.251937 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.252629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.254544 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.274189 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1410/2859] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:07 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:07.278315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.289210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d80d7-0fe7-4816-8508-9010b79039c6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.293852 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.294519 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.294812 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.295218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.295989 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.297605 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.307550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1450/2860] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:07.312104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.322039 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3dea-c106-4a12-a993-abfca190d996 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.327349 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.327913 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.328200 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.328476 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.329201 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.330800 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5812e00-5d03-46c1-a51d-cc0e17e99913 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.340751 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1411/2861] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:07.344751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.354680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd7c97-49fc-407e-b785-eb1608c8fac5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.359442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.360318 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.360601 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.360875 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] PATH_INFO: `/v3/projects/a0610be874004f3e9defe7eb2410afc1/users/e761519d54294e93825380c4eef61502/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.375748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0610be874004f3e9defe7eb2410afc1, user_id=e761519d54294e93825380c4eef61502, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.378396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.391348 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1451/2862] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:07 2022] PUT /identity/v3/projects/a0610be874004f3e9defe7eb2410afc1/users/e761519d54294e93825380c4eef61502/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:07.396372 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068f06-d1b3-41c3-a86c-a009849f25bf None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.396713 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068f06-d1b3-41c3-a86c-a009849f25bf None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.396998 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13068f06-d1b3-41c3-a86c-a009849f25bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.414829 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-13068f06-d1b3-41c3-a86c-a009849f25bf None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:07.416044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-13068f06-d1b3-41c3-a86c-a009849f25bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:07.474291 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1412/2863] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:42:07.483930 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:07.485642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:07.542252 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2337d8b-879d-416b-a8e6-7b45fd1e1259 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:07.545943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:07.546584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:07.546871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:07.547150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:07.556150 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:07.557568 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:07.567990 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1452/2864] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:11.432184 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.432685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.432780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.465622 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] MFA Rules not processed for user `e761519d54294e93825380c4eef61502`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:11.467939 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:11.546857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1413/2865] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 23 15:42:11.551535 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.561714 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113534b9-ebb1-4fec-99da-0db58f9e816e service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.566525 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.567214 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.567524 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.567803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.568544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.570462 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.600643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1453/2866] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:42:11 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:11.604062 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.615289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36ceec-1363-4cb5-98f0-ad8c4ad831b5 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.654222 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:11.682090 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.682872 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.683165 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.683902 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.684903 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.687854 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.712960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1414/2867] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:42:11 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:42:11.716923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.728249 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d6c46-99cb-4d4e-a0c6-7801754f7f8f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.734355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.735377 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.736200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.736491 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.737231 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.739428 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.754550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1454/2868] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:42:11.758636 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.770238 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47dc35-bca8-472b-8d0c-10013c3413bd admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.775051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.776043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.776324 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.776597 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] PATH_INFO: `/v3/projects/373a1a3b0bd649169ef99413cfe0a2da/users/464bc1e39d184bac90d2e9a0957b1579/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.792973 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373a1a3b0bd649169ef99413cfe0a2da, user_id=464bc1e39d184bac90d2e9a0957b1579, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.806452 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.820036 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1415/2869] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:11 2022] PUT /identity/v3/projects/373a1a3b0bd649169ef99413cfe0a2da/users/464bc1e39d184bac90d2e9a0957b1579/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:42:11.824234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.835923 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a7cfe-df6d-4056-94b2-860df0887bc8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.896733 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.897450 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.897770 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.898085 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.898826 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.900488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e8247-73cb-4d29-a631-91ee3ac9b387 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.911695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1455/2870] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 23 15:42:11.916060 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:11.927167 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fd524-d967-4640-953d-c4450e925999 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:11.932104 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:11.933010 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:11.933295 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:11.933573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] PATH_INFO: `/v3/projects/373a1a3b0bd649169ef99413cfe0a2da/users/464bc1e39d184bac90d2e9a0957b1579/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:11.936227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373a1a3b0bd649169ef99413cfe0a2da, user_id=464bc1e39d184bac90d2e9a0957b1579, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:11.939063 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:11.953289 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1416/2871] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:42:11 2022] PUT /identity/v3/projects/373a1a3b0bd649169ef99413cfe0a2da/users/464bc1e39d184bac90d2e9a0957b1579/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 23 15:42:16.536132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbdb56-f4d0-48eb-b863-76f95266c5d4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:16.536636 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbdb56-f4d0-48eb-b863-76f95266c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:16.536870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbdb56-f4d0-48eb-b863-76f95266c5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:16.564201 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7bbbdb56-f4d0-48eb-b863-76f95266c5d4 None None] MFA Rules not processed for user `464bc1e39d184bac90d2e9a0957b1579`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:16.565451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7bbbdb56-f4d0-48eb-b863-76f95266c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:16.569600 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:16.640320 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1456/2872] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:16.653750 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:16.655809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:16.745815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fd248-c1a6-4d2d-b907-cb26cac5bd56 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:16.750413 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544901ebce6e483cae9a9e03b3eac3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:16.751076 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:16.751391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:16.751681 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:16.817568 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:16.819559 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:16.832290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1417/2873] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:16.947825 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:16.948118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:16.948396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:17.022004 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:17.023431 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:17.101943 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1457/2874] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:42:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:17.179306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:17.181426 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:17.219271 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:17.296934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed868608-c56b-49e7-999c-b05634703ea2 service glance] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:17.302129 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:17.302795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:17.303079 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:17.303356 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:17.313870 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:17.315540 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2dc38-593a-4fc7-b4f3-e754c024cb59 service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:17.324869 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1418/2875] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:42:18.727224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:18.729047 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:18.826765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:18.858680 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314bdcc-8e78-4081-b066-cbfb2d0774ce None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:18.864489 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:18.865223 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:18.865581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:18.865931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:18.867854 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:18.882608 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:18.884551 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051bcef-c821-4175-b090-5de1887948ec service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:18.900128 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1458/2876] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:42:26.189660 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:26.190214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:26.190214 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:26.208123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] MFA Rules not processed for user `e761519d54294e93825380c4eef61502`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:26.209344 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:26.216162 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1419/2877] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:27.993901 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:27.994422 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:27.994548 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:28.013890 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:42:28.015151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:42:28.022580 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1459/2878] 10.222.0.46 () {58 vars in 1009 bytes} [Mon May 23 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:42:28.035643 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:28.047984 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60062a7-a253-4c8e-9bc3-4ba9d7f749d0 None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:28.053257 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:28.054131 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:28.054417 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:28.054810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:28.065606 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:28.067602 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:28.076724 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1420/2879] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:42:38.008138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=15 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:38.073370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=38 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:52.607822 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:42:52.662253 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf65b-e87f-4d73-b317-f4d7355ef2f2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:42:52.665898 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:42:52.666542 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:42:52.666827 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:42:52.667104 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:42:52.676149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:42:52.677565 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:42:52.687129 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1460/2880] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:42:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:43:02.682866 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=26 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:08.533780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:08.543542 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254808-2d56-4620-8781-94bae1ccd61d service swift] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:08.547624 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:08.548351 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:08.548692 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:08.549033 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:08.550910 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:08.568446 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:08.569910 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:08.581998 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36d556-9fc5-452f-9146-7e7df3ed8e5d service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:08.585692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:08.586338 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:08.586625 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:08.586908 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:08.588731 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:08.598828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:08.600292 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:08.609369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1461/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:44:08.637940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:08.639612 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:08.662170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1421/2882] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:09.855343 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:44:09.864651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ab286-018f-4eaa-8378-7ebbc1b41f9c service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:44:09.868301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:44:09.868947 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:44:09.869234 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:44:09.869522 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:44:09.871260 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:44:09.885611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:44:09.887042 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:44:09.898544 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1462/2883] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:44:18.659227 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=43 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:19.893379 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=12 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:30.728319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:30.731051 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:30.757484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6205936-8888-43f6-afd5-07a64d2521f5 service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:30.770498 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:30.771623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:30.771980 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:30.772321 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:30.774328 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:30.789700 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:30.791745 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4ec96-2eb8-44a1-b952-1c3007b92423 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:30.805960 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1422/2884] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:37.351301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:37.366581 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef88189-a4e7-4516-88fa-a4ff35d31738 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:37.372210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:37.372865 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:37.373155 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:37.373437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:37.375224 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:37.390151 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:37.392111 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:37.403514 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1463/2885] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:38.073676 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.074146 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.074245 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.092428 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] MFA Rules not processed for user `9740cc30848f47db8cc5fa655c06d763`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:38.093615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:38.101554 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1423/2886] 10.222.0.46 () {58 vars in 967 bytes} [Mon May 23 15:45:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:38.140575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:38.152651 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3fd9d-e0b3-46ab-a68f-fe9935b2899e service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:38.157814 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7457fcf08cac43a3831a145946f12bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:38.158481 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:38.158765 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:38.159043 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:38.168449 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:38.170007 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:38.178265 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1464/2887] 10.222.0.46 () {60 vars in 1384 bytes} [Mon May 23 15:45:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 23 15:45:41.495334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:41.497013 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:41.513573 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba54f-2b4a-431e-a575-aec3be4c410f None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:41.519502 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:41.520371 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:41.520887 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:41.521169 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:41.523267 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:41.538940 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:41.541043 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:41.553916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1424/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:44.562397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:44.576189 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b140b-e4ad-4bb8-8f64-039c40894e1e service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:44.581610 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:44.582271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:44.582557 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:44.582839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:44.584931 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:44.597894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:44.600496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:44.612781 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1465/2889] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:44.651979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:44.715032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857d08-4641-4d6f-a6e6-b41c69758bc4 service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:44.719649 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:44.720521 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:44.720807 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:44.721084 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] PATH_INFO: `/v3/users/e761519d54294e93825380c4eef61502` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:44.722285 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e761519d54294e93825380c4eef61502)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:44.724762 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:44.769996 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e761519d54294e93825380c4eef61502'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.776866 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e761519d54294e93825380c4eef61502'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.789610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e761519d54294e93825380c4eef61502'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.790282 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e761519d54294e93825380c4eef61502'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.797424 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e761519d54294e93825380c4eef61502'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:44.804619 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1425/2890] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:45:44 2022] DELETE /identity/v3/users/e761519d54294e93825380c4eef61502 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:44.977356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:44.991233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e157-672e-4e11-8d64-9012a8d456a6 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.053319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.054193 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.054475 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.054751 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] PATH_INFO: `/v3/projects/a0610be874004f3e9defe7eb2410afc1` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.055987 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0610be874004f3e9defe7eb2410afc1)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.057881 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.106878 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0610be874004f3e9defe7eb2410afc1', 'request_id': 'req-aca5b54f-b988-4bb3-abec-685ce9db7e0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.113255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0610be874004f3e9defe7eb2410afc1', 'request_id': 'req-aca5b54f-b988-4bb3-abec-685ce9db7e0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.121789 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0610be874004f3e9defe7eb2410afc1', 'request_id': 'req-aca5b54f-b988-4bb3-abec-685ce9db7e0f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.133748 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] The token cache is being invalidate because project a0610be874004f3e9defe7eb2410afc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:45.134036 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.134662 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.136255 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1466/2891] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:45:44 2022] DELETE /identity/v3/projects/a0610be874004f3e9defe7eb2410afc1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:45.140322 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.141882 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.155483 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1de79-b6a7-4705-b190-18485b80941a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.199966 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.214391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.215263 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.215574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.215851 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] PATH_INFO: `/v3/users/464bc1e39d184bac90d2e9a0957b1579` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.217078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] RBAC: Authorizing `identity:delete_user(user_id=464bc1e39d184bac90d2e9a0957b1579)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.219024 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.262916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464bc1e39d184bac90d2e9a0957b1579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.269702 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464bc1e39d184bac90d2e9a0957b1579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.282026 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464bc1e39d184bac90d2e9a0957b1579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.282679 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464bc1e39d184bac90d2e9a0957b1579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.290455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-cb5762be-5eab-48e0-b4b9-cb121883404d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464bc1e39d184bac90d2e9a0957b1579'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.297871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1426/2892] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:45:45 2022] DELETE /identity/v3/users/464bc1e39d184bac90d2e9a0957b1579 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:45.465328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.466758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.481425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b54f-b988-4bb3-abec-685ce9db7e0f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.537019 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.548176 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.549049 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.549334 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.549613 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] PATH_INFO: `/v3/projects/373a1a3b0bd649169ef99413cfe0a2da` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.550795 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=373a1a3b0bd649169ef99413cfe0a2da)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.552870 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.598502 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373a1a3b0bd649169ef99413cfe0a2da', 'request_id': 'req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.604088 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373a1a3b0bd649169ef99413cfe0a2da', 'request_id': 'req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.611332 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373a1a3b0bd649169ef99413cfe0a2da', 'request_id': 'req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.623034 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] The token cache is being invalidate because project 373a1a3b0bd649169ef99413cfe0a2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:45:45.623319 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.623966 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-91ed5cf7-2f93-46b9-8fc4-d82ad1b4345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:45:45.625492 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1467/2893] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:45:45 2022] DELETE /identity/v3/projects/373a1a3b0bd649169ef99413cfe0a2da => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:45.631370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.631675 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.631956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.650055 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:45.651290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.709405 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1427/2894] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:45.717186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.717488 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.717772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.736719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:45.737921 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:45.746692 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1468/2895] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:45.750810 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.761524 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00627b8a-95bd-4842-b6c6-fffd25f1268a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.766119 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.766772 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.767073 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.767334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] PATH_INFO: `/v3/domains` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.768089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80365) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 23 15:45:45.768399 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.770002 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.781701 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1428/2896] 10.222.0.46 () {58 vars in 1152 bytes} [Mon May 23 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 23 15:45:45.786137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.795279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e6c3-b4e4-480b-96c6-4bce0e78640e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.800018 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.800667 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.800951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.801229 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.802420 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.804335 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.840138 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1469/2897] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:45.844334 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.854560 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88763fb6-1eb1-46ef-922a-e28a3db1d06e admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.903706 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.914871 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.915574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.915855 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.916128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.916852 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.918795 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.938078 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1429/2898] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:45:45 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:45.942218 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.953132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218dc17-8cc2-436f-b67b-cf4a0a411d02 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.958115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.958934 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.959217 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.959582 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.960251 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.961839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:45.971655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1470/2899] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:45.975987 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:45.985845 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2cf98-b7d6-4baa-912f-a4172f2e6fc8 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:45.991072 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:45.991758 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:45.992037 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:45.992306 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:45.993053 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:45.994632 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0366b-ec4a-4a07-9c3e-0849f9146a5c admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.005008 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1430/2900] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:46.008902 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.018909 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308a9bb-7b25-4f41-9c9e-76d6747ce447 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.024137 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.025061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.025352 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.025637 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] PATH_INFO: `/v3/projects/d3395f7ce8a94d3fafb63058441f57ec/users/df19a6de6fa040db85025378349bc487/roles/b5590f1e1caf40fa8b92fbc8e9b2c173` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.042437 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3395f7ce8a94d3fafb63058441f57ec, user_id=df19a6de6fa040db85025378349bc487, role_id=b5590f1e1caf40fa8b92fbc8e9b2c173)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.045126 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.058980 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1471/2901] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:45:46 2022] PUT /identity/v3/projects/d3395f7ce8a94d3fafb63058441f57ec/users/df19a6de6fa040db85025378349bc487/roles/b5590f1e1caf40fa8b92fbc8e9b2c173 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:46.064319 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8f52-fb5e-4451-90ce-0d17c9962bda None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.064610 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8f52-fb5e-4451-90ce-0d17c9962bda None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.064886 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd8f52-fb5e-4451-90ce-0d17c9962bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.082471 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-67fd8f52-fb5e-4451-90ce-0d17c9962bda None None] MFA Rules not processed for user `b624fe749c804741bda23ecac0c46159`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:46.083922 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-67fd8f52-fb5e-4451-90ce-0d17c9962bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.142583 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1431/2902] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:46.152539 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:46.154256 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:46.211982 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d53b95-3f2c-4fe8-a007-b64050b744d1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:46.215641 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:46.216296 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:46.216586 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:46.216868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:46.226282 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:46.227758 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:46.237096 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1472/2903] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:45:50.163138 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.163661 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.163778 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.191767 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] MFA Rules not processed for user `df19a6de6fa040db85025378349bc487`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:50.193766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:50.263651 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1432/2904] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:50.268271 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.278506 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167374-9872-4a1d-a793-b45e7f9f6fd3 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.283328 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.284028 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.284315 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.284592 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.285298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.288071 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.296894 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:50.318108 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1473/2905] 10.222.0.46 () {60 vars in 1152 bytes} [Mon May 23 15:45:50 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:50.322209 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.333145 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a414-2029-4083-b1a9-1e94a124244a None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.411038 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.411833 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.412123 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.412401 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.413114 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.415044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.422665 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:50.446323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1433/2906] 10.222.0.46 () {60 vars in 1143 bytes} [Mon May 23 15:45:50 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 23 15:45:50.450370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.461396 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84af61-b37d-4735-b3b9-2e156ccb5496 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.466149 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.466832 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.467118 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.467442 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.468171 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.469801 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.483355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1474/2907] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:50.487600 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.499136 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218c5fe-a976-4baf-9f0d-4cdc29c253f4 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.504766 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.505896 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.506179 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.506455 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] PATH_INFO: `/v3/projects/a4898208b7e446bcac42cb00799d8290/users/09fb558cfa45421ca2d639fb76a0b746/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.523128 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4898208b7e446bcac42cb00799d8290, user_id=09fb558cfa45421ca2d639fb76a0b746, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.525877 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.541844 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1434/2908] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:45:50 2022] PUT /identity/v3/projects/a4898208b7e446bcac42cb00799d8290/users/09fb558cfa45421ca2d639fb76a0b746/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:50.545991 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.557174 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284676ad-977a-4155-8380-e28c70530eca admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.618115 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.618803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.619093 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.619430 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.620141 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.621743 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24220cf6-d458-4ba5-87a1-cd191bdc5437 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.637993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1475/2909] 10.222.0.46 () {58 vars in 1121 bytes} [Mon May 23 15:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 23 15:45:50.639439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:50.650546 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56782fb-6666-4452-9223-1c595ab60708 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:50.655623 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:50.656525 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:50.656808 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:50.657112 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] PATH_INFO: `/v3/projects/a4898208b7e446bcac42cb00799d8290/users/09fb558cfa45421ca2d639fb76a0b746/roles/a6b7c59e454546879b7d1558ef6fb0ee` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:50.659170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4898208b7e446bcac42cb00799d8290, user_id=09fb558cfa45421ca2d639fb76a0b746, role_id=a6b7c59e454546879b7d1558ef6fb0ee)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:50.662723 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:50.674497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1435/2910] 10.222.0.46 () {60 vars in 1482 bytes} [Mon May 23 15:45:50 2022] PUT /identity/v3/projects/a4898208b7e446bcac42cb00799d8290/users/09fb558cfa45421ca2d639fb76a0b746/roles/a6b7c59e454546879b7d1558ef6fb0ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:45:55.065391 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638bfc5-4862-4a8a-a118-bba6fcbf5787 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.066191 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638bfc5-4862-4a8a-a118-bba6fcbf5787 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.066668 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638bfc5-4862-4a8a-a118-bba6fcbf5787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.097606 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f638bfc5-4862-4a8a-a118-bba6fcbf5787 None None] MFA Rules not processed for user `09fb558cfa45421ca2d639fb76a0b746`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:55.099726 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f638bfc5-4862-4a8a-a118-bba6fcbf5787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:55.172924 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1476/2911] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:45:55.188784 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:45:55.190759 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:55.267044 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f4dfb-3444-4114-8e49-55cbb5f2c444 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:45:55.272923 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:45:55.273614 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:55.273895 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:55.274170 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:55.331990 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:45:55.334608 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:45:55.344549 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1436/2912] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:45:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:45:56.337624 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:45:56.338156 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:45:56.338259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:45:56.355868 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] MFA Rules not processed for user `df19a6de6fa040db85025378349bc487`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:45:56.357061 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:45:56.364655 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1477/2913] 10.222.0.46 () {58 vars in 957 bytes} [Mon May 23 15:45:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:46:05.340685 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:INSERT=4,keystone:SELECT=73 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:06.350677 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:14.928857 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:14.930305 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:14.989545 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ece35-71ab-4c91-936f-67bbb0d9b724 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:14.993475 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:14.994161 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:14.994470 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:14.994752 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:14.996593 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:15.007788 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:15.009337 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:15.017862 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1437/2914] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:46:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:15.447889 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:15.449294 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:15.519698 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153e942-935b-4d3e-a02c-803bcb8eaa4e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:15.524707 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:15.525356 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:15.525642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:15.525917 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:15.527727 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:15.539345 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:15.540928 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:15.550715 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1478/2915] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:24.957867 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:24.973370 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3c73-b548-43d3-9978-0427453fc97e service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:24.979003 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:24.979691 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:24.979978 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:24.980253 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:24.982041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:46:24.995301 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:24.996956 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:25.008032 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1438/2916] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:25.546515 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:27.306760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:46:27.316955 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a068b-2d5f-47e1-9cfb-2cf181b01319 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:46:27.320509 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:46:27.321145 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:46:27.321425 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:46:27.321699 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:46:27.330564 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:46:27.332944 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:46:27.342259 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1479/2917] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:46:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:46:35.003350 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=32 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:37.338069 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:22.787698 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:47:22.789336 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:22.803905 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7f89-9809-449a-bfde-8b2cc5b6e911 service nova] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:47:22.809765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:47:22.810416 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:47:22.810703 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:47:22.810981 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:47:22.812773 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:47:22.825497 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:47:22.826510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:47:22.836815 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1439/2918] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:47:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:47:32.832916 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:10.676368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:10.685689 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c04068-05d5-49d4-9f95-d73106e05bbc service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:10.689291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:10.689925 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:10.690208 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:10.690487 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:10.692368 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:10.706803 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:10.708245 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:10.719186 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1480/2919] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:11.892603 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:11.902831 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172dfd-2062-44c9-bd12-027d9f8a78bc service placement] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:11.906437 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:11.907339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:11.907659 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:11.907934 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:11.909719 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:11.923684 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:11.925111 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020aae28-8175-4753-8c53-90083b1997a8 service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:11.936574 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1440/2920] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:20.714322 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:21.270125 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:21.279496 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d35f1f-fb3a-489a-ba76-712a74b17a4c service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:21.283390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:21.284078 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:21.284369 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:21.284642 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:21.286892 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:21.298434 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:21.299913 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916acb1-72b9-427d-80b3-1674ee94a9f0 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:21.308569 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1481/2921] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:21.931921 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=6 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:25.041710 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812561a-0c7e-4dbe-a0df-d3b1211248ab None None] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.042400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812561a-0c7e-4dbe-a0df-d3b1211248ab None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.042400 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812561a-0c7e-4dbe-a0df-d3b1211248ab None None] PATH_INFO: `/` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.043979 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1441/2922] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:25.049760 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0fd90-1b2e-4008-8a89-65d8208c5efd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.050200 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0fd90-1b2e-4008-8a89-65d8208c5efd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.050452 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0fd90-1b2e-4008-8a89-65d8208c5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.091074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e8f0fd90-1b2e-4008-8a89-65d8208c5efd None None] MFA Rules not processed for user `d7bebb1f5cb1475c80dc46849e7cc78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:25.092374 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e8f0fd90-1b2e-4008-8a89-65d8208c5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:25.099159 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1482/2923] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:25.112028 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812561a-0c7e-4dbe-a0df-d3b1211248ab None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:25.123735 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812561a-0c7e-4dbe-a0df-d3b1211248ab None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:25.127391 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:25.128070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.128339 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.128617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.136917 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:25.138358 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62004b43-de5b-4807-a1b4-843429e77d8b service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:25.146323 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1442/2924] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 23 15:49:25.229012 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6f9e-7085-42b1-8cb5-d93f21922846 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.229302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6f9e-7085-42b1-8cb5-d93f21922846 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.229583 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6f9e-7085-42b1-8cb5-d93f21922846 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.230983 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1483/2925] 10.222.0.46 () {54 vars in 921 bytes} [Mon May 23 15:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 23 15:49:25.236275 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] REQUEST_METHOD: `POST` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.236562 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.236835 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.272252 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.auth.core [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] MFA Rules not processed for user `b485e0918e744da9875e48e7906264e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80365) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 23 15:49:25.273364 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:49:25.283353 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1443/2926] 10.222.0.46 () {58 vars in 1018 bytes} [Mon May 23 15:49:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 23 15:49:25.293695 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6f9e-7085-42b1-8cb5-d93f21922846 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:49:25.304927 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6f9e-7085-42b1-8cb5-d93f21922846 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:49:25.308575 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:49:25.309210 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:49:25.309523 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:49:25.309800 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:49:25.319837 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:49:25.321864 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:49:25.332951 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1484/2927] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:49:35.269959 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=15 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:35.327961 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=21 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:13.473125 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:13.493210 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b9ec-777b-423a-8351-3b036c838afc None None] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:13.496848 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:13.497484 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:13.497765 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:13.498041 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:13.522266 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:13.524089 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:13.533646 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1444/2928] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:14.383643 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:14.442370 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a45b-62a6-444a-ab7f-23b737e3ca1e service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:14.449397 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b485e0918e744da9875e48e7906264e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:14.450090 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:14.450839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:14.450839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:14.453063 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:14.511301 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:14.513298 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:14.528355 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1485/2929] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:51:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:18.259941 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:18.268629 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d0a18-de45-4565-9b8b-0c9f7e0f192d service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:18.272331 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7bebb1f5cb1475c80dc46849e7cc78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:18.273042 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:18.273326 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:18.273601 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:18.344009 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:18.345377 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:18.364077 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1445/2930] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:21.383839 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:21.399233 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d66ae0-50cf-4ca0-99b8-1399b5625af3 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:21.406584 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:21.407198 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:21.407527 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:21.407872 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:21.409719 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:21.423611 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:21.425363 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:21.439074 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1486/2931] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:51:24.550840 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:24.561819 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472fdf5-f777-4ac9-9567-288f5bd462be service neutron] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:24.567556 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:24.568441 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:24.571515 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:24.571809 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] PATH_INFO: `/v3/users/df19a6de6fa040db85025378349bc487` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:24.573099 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df19a6de6fa040db85025378349bc487)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:24.575071 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:24.630813 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df19a6de6fa040db85025378349bc487'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.638070 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df19a6de6fa040db85025378349bc487'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.649884 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df19a6de6fa040db85025378349bc487'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.650550 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df19a6de6fa040db85025378349bc487'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.657439 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df19a6de6fa040db85025378349bc487'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.664118 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1446/2932] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:51:24 2022] DELETE /identity/v3/users/df19a6de6fa040db85025378349bc487 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:24.835390 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:24.846649 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7773e9-3e7e-44ad-8b2a-7351a8e158e5 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:24.902219 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:24.903016 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:24.903302 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:24.903871 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] PATH_INFO: `/v3/projects/d3395f7ce8a94d3fafb63058441f57ec` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:24.905169 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3395f7ce8a94d3fafb63058441f57ec)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:24.907059 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:24.952329 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3395f7ce8a94d3fafb63058441f57ec', 'request_id': 'req-3166465f-bfbc-411b-9798-e528e565b8cf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.957828 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3395f7ce8a94d3fafb63058441f57ec', 'request_id': 'req-3166465f-bfbc-411b-9798-e528e565b8cf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.965168 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3395f7ce8a94d3fafb63058441f57ec', 'request_id': 'req-3166465f-bfbc-411b-9798-e528e565b8cf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.984521 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:24.988772 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] The token cache is being invalidate because project d3395f7ce8a94d3fafb63058441f57ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:51:24.989291 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.990132 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:24.992779 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1487/2933] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:51:24 2022] DELETE /identity/v3/projects/d3395f7ce8a94d3fafb63058441f57ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:24.997014 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:24.998461 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:25.012173 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b444-e862-4ad6-a916-54304df1c9d5 admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:25.020067 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:25.071901 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:25.072780 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:25.073061 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:25.073342 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] PATH_INFO: `/v3/users/09fb558cfa45421ca2d639fb76a0b746` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:25.074533 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fb558cfa45421ca2d639fb76a0b746)` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:25.076510 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:25.122516 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fb558cfa45421ca2d639fb76a0b746'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.129388 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fb558cfa45421ca2d639fb76a0b746'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.141716 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fb558cfa45421ca2d639fb76a0b746'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.142290 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fb558cfa45421ca2d639fb76a0b746'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.150674 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.notifications [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fb558cfa45421ca2d639fb76a0b746'} {{(pid=80365) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.157617 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1447/2934] 10.222.0.46 () {58 vars in 1223 bytes} [Mon May 23 15:51:24 2022] DELETE /identity/v3/users/09fb558cfa45421ca2d639fb76a0b746 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:25.332077 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:51:25.333561 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:51:25.352914 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166465f-bfbc-411b-9798-e528e565b8cf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:51:25.411183 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b624fe749c804741bda23ecac0c46159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a4ecdc8eee23475faa49db60f90175a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:51:25.412000 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:51:25.412279 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:51:25.412550 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] PATH_INFO: `/v3/projects/a4898208b7e446bcac42cb00799d8290` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:51:25.414033 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4898208b7e446bcac42cb00799d8290)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:51:25.416027 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:51:25.461879 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4898208b7e446bcac42cb00799d8290', 'request_id': 'req-53259b16-7700-45b2-b05c-ff74adafebf5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.467616 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4898208b7e446bcac42cb00799d8290', 'request_id': 'req-53259b16-7700-45b2-b05c-ff74adafebf5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.475109 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4898208b7e446bcac42cb00799d8290', 'request_id': 'req-53259b16-7700-45b2-b05c-ff74adafebf5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.486497 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] The token cache is being invalidate because project a4898208b7e446bcac42cb00799d8290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 23 15:51:25.486790 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.487451 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-53259b16-7700-45b2-b05c-ff74adafebf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 23 15:51:25.488993 dv-cinder-840678-12-smb devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1488/2935] 10.222.0.46 () {58 vars in 1232 bytes} [Mon May 23 15:51:25 2022] DELETE /identity/v3/projects/a4898208b7e446bcac42cb00799d8290 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 23 15:51:35.154276 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:35.483472 dv-cinder-840678-12-smb devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:29.735506 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Authenticating user token {{(pid=80365) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 23 15:52:29.736898 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:29.833152 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2dc2bc-05c7-465a-be52-63110e92269a admin admin] Validating token access rules against request {{(pid=80365) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 23 15:52:29.892958 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc27c2736384fdd91fad3d94422807b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfda9836ff164040afec83b0a7c9cb4c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80365) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 23 15:52:29.893645 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] REQUEST_METHOD: `GET` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 23 15:52:29.893925 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 23 15:52:29.894199 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80365) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 23 15:52:29.896031 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.fernet_utils [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80365) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 23 15:52:29.907579 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 23 15:52:29.909149 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11f692-bbc2-4343-853b-cc0bab9288c1 service placement] RBAC: Authorization granted {{(pid=80365) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 23 15:52:29.919615 dv-cinder-840678-12-smb devstack@keystone.service[80365]: [pid: 80365|app: 0|req: 1448/2936] 10.222.0.46 () {60 vars in 1365 bytes} [Mon May 23 15:52:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 23 15:52:39.915488 dv-cinder-840678-12-smb devstack@keystone.service[80365]: DEBUG dbcounter [-] [80365] Writing DB stats keystone:SELECT=67 {{(pid=80365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}